VIDEO DECODER METHOD, AND VIDEO ENCODER METHOD

专利摘要:
video decoder method, video decoder apparatus, video encoder method, and video encoder device. a method and device for encoding a video using a hierarchically structured data unit and a method and device for decoding it are disclosed. according to an embodiment of the present invention, a video encoding apparatus based on a hierarchical structure data unit; determines a context model that is used for entropy encoding a symbol based on the hierarchical information of a data unit, to which a symbol belongs to the encoded frame; and entropy encodes the symbol using the given context model.
公开号:BR112013017395B1
申请号:R112013017395-5
申请日:2012-01-06
公开日:2020-10-06
发明作者:Sun-Il Lee；Hae-kyung JUNG；Min-su CHEON
申请人:Samsung Electronics Co., Ltd；
IPC主号:

专利说明:

Technical Domain
[0001] The present invention relates to the encoding and decoding of video and, more particularly, the encoding and decoding of a symbol of a video codec. Previous Art
[0002] According to image compression methods, such as advanced video encoding (AVC) MPEG-1, MPEG-2 or MPEG-4 H.264 / MPEG-4, an image is divided into blocks having a predetermined size and then residual data from the blocks are obtained by inter or intra forecast. Residual data is compressed by transformation, quantization, digitization, RLC compression, and entropy coding. In entropy coding, a syntax element, such as a discrete cosine transform coefficient (DCT) or a motion vector, is encoded by entropy to output a bit stream. At the tip of a decoder, elements of syntax are extracted from the bit stream, and decoding is performed based on elements extracted from the syntax. Detailed Description of the Invention Technical problem
[0003] The present invention provides a method and device for efficiently entropy and decode, symbols that are image information, selecting a context model of an image codec based on hierarchically structured data units, using information hierarchical structure. Technical Solution
[0004] In accordance with one aspect of the present invention, entropy encoding and decoding is performed, selecting a context model based on a combination of hierarchical structure information and additional encoding related information, different from hierarchical structure information. Advantageous Effects
[0005] In accordance with the present invention, a video compression efficiency based on a hierarchically structured data unit can be improved. Description of Drawings
[0006] Fig. 1 is a block diagram of a device for encoding a video, according to an embodiment of the present invention;
[0007] Fig. 2 is a block diagram of a device for decoding a video, according to an embodiment of the present invention;
[0008] Fig. 3 is a diagram for describing a concept of coding units, according to an embodiment of the present invention;
[0009] Fig. 4 is a block diagram of a video encoder, based on encoding units with a hierarchical structure, according to an embodiment of the present invention;
[00010] Fig. 5 is a block diagram of a video decoder, based on encoding units with a hierarchical structure, according to an embodiment of the present invention;
[00011] Fig. 6 is a diagram, illustrating coding units, according to depths and partitions, according to an embodiment of the present invention;
[00012] Fig. 7 is a diagram for describing a relationship between coding units and transformation units, according to an embodiment of the present invention;
[00013] Fig. 8 is a diagram for describing coding information, according to depths, according to an embodiment of the present invention;
[00014] Fig. 9 is a diagram for describing coding units, according to depths, according to an embodiment of the present invention;
[00015] Figs. 10, 11 and 12 are diagrams for describing a relationship between a coding unit, a prediction unit, and a frequency transformation unit, according to an embodiment of the present invention;
[00016] Fig. 13 is a diagram to describe a relationship between a coding unit, a forecasting unit, and a transformation unit, according to the coding mode information in Table 1;
[00017] Fig. 14 is a block diagram, which illustrates a structure of an entropy coding apparatus, according to an embodiment of the present invention;
[00018] Fig. 15 illustrates a hierarchically structured data unit and division information of the hierarchically structured data unit, according to an embodiment of the present invention;
[00019] Figs. 16 and 17 are reference views, illustrating symbols indicating a hierarchically structured data unit, in accordance with an embodiment of the present invention;
[00020] Fig. 18 is a reference view for describing an entropy coding process for a transformation coefficient, according to an embodiment of the present invention;
[00021] Fig. 19 illustrates context indexes for determining a context model based on the size of a data unit, in accordance with an embodiment of the present invention;
[00022] Fig. 20 is a reference view, illustrating a context model, according to an embodiment of the present invention;
[00023] Fig. 21 is a graph of a probability value for the occurrence of MPS, according to an embodiment of the present invention;
[00024] Fig. 22 illustrates context indexes for determining a context model based on the size of a data unit, in accordance with another embodiment of the present invention;
[00025] Figs. 23 and 24 are reference views, illustrating a set of context index mapping tables based on information about the position of a data unit, in accordance with an embodiment of the present invention;
[00026] Fig. 25 is a reference view, illustrating the determination of a context index based on a combination of hierarchical information and additional information, other than hierarchical information, in accordance with an embodiment of the present invention. ;
[00027] Fig. 26 is a diagram for describing a binary arithmetic coding process performed by a normal coder of Fig. 14;
[00028] Fig. 27 is a flowchart of a video encoding method, using a hierarchically structured data unit, according to an embodiment of the present invention;
[00029] Fig. 28 is a block diagram, which illustrates a structure of an entropy decoding apparatus, according to an embodiment of the present invention; and
[00030] Fig. 29 is a flow chart of a video decoding method, using a hierarchically structured data unit, according to another embodiment of the present invention. Best Mode
[00031] In accordance with an aspect of the present invention, a method of encoding video is provided, comprising: encoding a frame forming the video based on a hierarchically structured data unit; determine a context model used for entropy encoding the symbol based on hierarchical information from a data unit, to which the encoded frame symbol belongs; and entropy encoding the symbol using the given context model.
[00032] In accordance with another aspect of the present invention, a video encoding device is provided, comprising: a hierarchical encoder for encoding a frame forming the video based on a hierarchically structured data unit; and an entropy encoder to determine a context model used for entropy encoding a symbol based on hierarchical information from a data unit, to which the encoded frame symbol belongs, and to encode the symbol using the given context model.
[00033] In accordance with another aspect of the present invention, a video decoding method is provided, comprising: extracting a symbol from an encoded frame, based on a hierarchically structured data unit, by analyzing an encoded bit stream; determine a context model used for entropy decoding of the symbol based on hierarchical information from a data unit, to which the symbol belongs; and entropy decoding the symbol, using the given context model.
[00034] In accordance with another aspect of the present invention, a video decoding apparatus is provided, comprising: a symbol extraction unit for extracting a symbol from a coded frame, based on a hierarchically structured data unit, by analyzing an encoded bit stream; and an entropy decoder to determine a context model used for entropy decoding of the symbol, based on hierarchical information from a data unit, to which the symbol belongs, and entropy decoding the symbol using the given context model. Invention Mode
[00035] Hereinafter, an "image" described in various embodiments of this Order can be a comprehensive concept, referring not only to a still image, but also to a video image.
[00036] When several operations are performed with data related to an image, the data related to the image are divided into groups of data, and the same operation can be performed with data included in the same data group. In this specification, a group of data, formed according to predetermined standards, is referred to as a "data unit". Ahead, an operation performed on each "data unit" is understood to be performed, using data included in a data unit.
[00037] Hereinafter, a method and device for encoding and decoding video, in which a symbol having a tree structure is encoded or decoded based on a transformation unit and a coding unit having a tree structure, according to an embodiment of the present invention, will be described with reference to Figures 1 to 13. In addition, the entropy encoding and decoding method used in video encoding and decoding, described with reference to Figures 1 to 13, will be described in detail with reference to FIGS. 14 to 29.
[00038] Fig. 1 is a block diagram of a video encoding apparatus 100, according to an embodiment of the present invention.
[00039] The video encoding apparatus 100 includes a hierarchical encoder 110 and an entropy encoder 120.
[00040] The hierarchical encoder 110 can divide a current frame to be encoded, in predetermined data units to perform encoding in each of the data units. In detail, hierarchical encoder 110 can divide a current frame based on a maximum encoding unit, which is a maximum size encoding unit. The maximum coding unit, according to an embodiment of the present invention, can be a data unit having a size of 32 x 32, 64 x 64, 128 x 128, 256 x 256 etc., in which a format of the data unit is a square, which has a width and length in squares of 2 and is greater than 8.
[00041] A coding unit, according to an embodiment of the present invention, can be characterized by a maximum size and depth. Depth denotes the number of times that the coding unit is spatially divided from the maximum coding unit, and as the depth increases, coding units according to depths can be divided, from the maximum coding unit in one unit minimum coding. A maximum coding depth is a higher depth, and a minimum coding depth is a lower depth. Since a size of a coding unit corresponding to each depth decreases, as the depth of the maximum coding unit increases, a coding unit corresponding to a higher depth may include a plurality of coding units corresponding to the lower depths.
[00042] As described above, image data from the current frame is divided into the maximum encoding units, according to a maximum encoding unit size, and each of the maximum encoding units can include encoding units, which are divided according to according to depths. Since the maximum coding unit, according to an embodiment of the present invention, is divided according to depths, the image data of a spatial domain included in the maximum coding unit can be classified hierarchically, according to depths .
[00043] A maximum depth and a maximum size of a coding unit, which limit the total number of times that a height and width of the maximum coding unit are divided hierarchically, can be predetermined.
[00044] The hierarchical encoder 110 encodes at least one division region obtained, dividing a region of the maximum encoding unit, according to depths, and determines a depth to finally output encoded image data, according to at least least one division region. In other words, hierarchical encoder 110 determines an encoded depth, by encoding the image data in the encoding units, according to depths, according to the maximum encoding unit of the current frame, and selecting a depth having the smallest error of codification. The determined coded depth and the encoded image data, according to maximum coding units, are output to the entropy encoder 120.
[00045] The image data in the maximum encoding unit is encoded based on the encoding units corresponding to at least a depth equal to or less than the maximum depth, and encoding results of the image data are compared based on each of the units coding, according to depths. A depth having the least coding error can be selected, after comparing the coding errors of the coding units, according to depths. At least one coded depth can be chosen for each maximum coding unit.
[00046] The size of the maximum coding unit is divided, when a coding unit is hierarchically divided, according to depths, and when the number of coding units increases. In addition, even if the coding units correspond to the same depth in a maximum coding unit, the condition of dividing each of the coding units corresponding to the same depth to a lower depth is determined, measuring a coding error. of the image data of each encoding unit, separately. In this sense, even when image data is included in a maximum coding unit, the image data is divided into regions, according to depths, and coding errors can vary, according to the regions in the maximum coding unit and thus, the coded depths may differ, according to regions in the image data. Thus, one or more coded depths can be determined in a maximum coding unit, and the image data from the maximum coding unit can be divided, according to coding units of at least one coded depth.
[00047] In this sense, hierarchical encoder 110 can determine encoding units having a tree structure included in the maximum encoding unit. The 'coding units having a tree structure', according to an embodiment of the present invention, include coding units corresponding to a depth determined to be the coded depth, among all coding units, according to included depths in the maximum coding unit. A coding unit having a coded depth can be hierarchically determined, according to depths in the same region as the maximum coding unit, and can be determined independently in different regions. Likewise, a depth encoded in one current region can be determined independently of a depth encoded in another region.
[00048] A maximum depth, according to an embodiment of the present invention, is an index related to the number of times the division is performed, from a maximum coding unit to a minimum coding unit. A first maximum depth, according to an embodiment of the present invention, can denote the total number of times the division is carried out, from the maximum coding unit to the minimum coding unit. A second maximum depth, according to an embodiment of the present invention, can denote the total number of depth levels, from the maximum coding unit to the minimum coding unit. For example, when a maximum coding unit depth is 0, a coding unit depth, where the maximum coding unit is divided once, can be set to 1, and a depth of a coding unit, in that the maximum coding unit is divided twice, it can be set to 2. Here, if the minimum coding unit is a coding unit, where the maximum coding unit is divided four times, there are five levels of depth 0, 1, 2, 3 and 4, and so the first maximum depth can be set to 4, and the second maximum depth can be set to 5.
[00049] Forecast and transformation coding can be performed, according to the maximum coding unit. Prediction coding and transformation are also performed based on the coding units, according to a depth equal to or less than the maximum depth, according to the maximum coding unit.
[00050] As the number of coding units, according to depths, increases, whenever the maximum coding unit is divided, according to depths, coding including forecasting coding and transformation is performed in all units coding, according to depths generated, when the depth is increased. For convenience of description, the prediction coding and transformation will now be described based on a coding unit of a current depth, in a maximum coding unit.
[00051] The video encoding apparatus 100 can variablely select a size or format of a data unit to encode the image data. To encode image data, operations, such as prediction, transformation, and entropy coding, are performed and, at this point, the same data unit can be used for all operations, or different data units can be used for each operation.
[00052] For example, the video encoding apparatus 100 may select not only an encoding unit for encoding the image data, but also a data unit other than the encoding unit, in order to carry out the prediction encoding in the image data in the encoding unit.
[00053] To perform prediction coding in the maximum coding unit, the prediction coding can be carried out based on a coding unit corresponding to a coded depth, that is, based on a coding unit, which is no longer divided in coding units corresponding to a lower depth. In the following, the coding unit, which is no longer divided and becomes a base unit for forecast coding, will now be referred to as a 'forecast unit'. A obtained partition, dividing the forecast unit, can include a forecast unit or a data unit obtained, dividing at least one between the height and width of the forecast unit.
[00054] For example, when a 2N x 2N coding unit (where N is a positive integer) is no longer divided and becomes a 2N * 2N forecasting unit, a partition size can be 2N x 2N , 2N x N, N x 2N, or N x N. Examples of a partition type include symmetric partitions, which are obtained by symmetrically dividing a height or width of the forecasting unit, partitions obtained by dividing the height or width asymmetrically of the forecast unit, such as l: n or n: l, partitions that are obtained by dividing the forecast unit geometrically, and partitions having arbitrary formats.
[00055] A prediction mode of the prediction unit can be at least one of an intra mode, an inter mode, and a jump mode. For example, intra mode or inter mode can be performed on the 2N x 2N, 2N x N, N x 2N, or N x N partition. In addition, the jump mode can be performed only on the 2N x 2N partition . Coding is performed independently in a forecasting unit from a coding unit, thus selecting a forecasting mode with the least coding error.
[00056] The video coding apparatus 100 can also effect the transformation of the image data in a coding unit, based not only on the coding unit to encode the image data, but also on the basis of a data unit, which is different from the encoding unit.
[00057] To perform the transformation in the coding unit, the transformation can be performed based on a data unit having a size less than or equal to the coding unit. For example, the data unit for the transformation can include a data unit for an intra mode and a data unit for an inter mode.
[00058] A data unit used as the basis for the transformation will now be referred to as a 'transformation unit'. As for the coding unit, the transformation unit in the coding unit can be recursively divided into smaller regions, so that the transformation unit can be determined independently, in units of regions. Thus, residual data in the coding unit can be divided, according to the transformation unit having the tree structure, according to transformation depths.
[00059] A transformation depth, indicating the number of times the division is carried out to reach the transformation unit, dividing the height and width of the coding unit, can also be defined in the transformation unit. For example, in a current coding unit of 2N x 2N, a transformation depth can be 0, when the size of a transformation unit is 2N x 2N, it can be 1, when the size of a transformation unit is N x N, and can be 2, when the size of a transformation unit is N / 2 x N / 2. That is, the transformation unit, having the tree structure, can also be defined according to transformation depths.
[00060] Coding information, according to coding units corresponding to an encoded depth, requires not only information about the coded depth, but also information about prediction and transformation coding. Thus, hierarchical encoder 110 not only determines a coded depth having the least coding error, but also determines a partition type in a forecast unit, a forecast mode according to forecast units, and a size of a unit of forecast. transformation to transformation.
[00061] Coding units, according to a tree structure in a maximum coding unit, and a method of determining a partition, according to embodiments of the present invention, will be described in detail later with reference to the Figures 3 to 12.
[00062] The hierarchical encoder 110 can measure an encoding error of encoding unit, according to depths, using Rate-distortion Optimization based on Lagrange multipliers.
[00063] Entropy encoder 120 outputs the image data of the maximum encoding unit, which is encoded based on at least one encoded depth, determined at least by hierarchical encoder 110, and information on the encoding mode, according to coded depth, in a bit stream. The encoded image data can be a result of encoding residual image data. Information about the coding mode, according to the coded depth, can include information about the coded depth, information about the type of partition in the forecast unit, information about the forecast mode, and information about the size of the transformation unit . In particular, as will be described later, when encoding the image data of the maximum encoding unit and symbols related to an encoding mode, according to depths, entropy encoder 120 can perform entropy encoding by selecting a context model based on information from the hierarchical structure of the hierarchically structured data unit, described above, and information about a color component used in a video encoding method, other than the hierarchical structure.
[00064] Information about the encoded depth can be defined, using division information, according to depths, which indicates whether the encoding was performed in encoding units of a lesser depth, instead of a current depth. If the current depth of the current encoding unit is the encoded depth, image data in the current encoding unit is encoded and output and therefore the division information can be set, so as not to divide the current encoding unit to a lesser depth . Alternatively, if the current depth of the current coding unit is not the coded depth, coding is carried out in the coding unit of the lower depth and thus the division information can be set, to divide the current coding unit, to obtain the coding units of the lower depth.
[00065] If the current depth is not the coded depth, coding is performed in the coding unit, which has been divided into the coding unit for the lower depth. Since at least one bottom depth coding unit exists in a current depth coding unit, coding is performed repeatedly on each bottom depth coding unit and therefore coding can be performed recursively for the coding units having the same depth.
[00066] Since the coding units having a tree structure are determined for a maximum coding unit, and information about at least one coding mode is determined for a coding unit of a coded depth, information about at least one encoding mode can be determined for a maximum encoding unit. In addition, an encoded depth of the image data of the maximum encoding unit may be different, according to locations, since the image data is divided hierarchically, according to depths and thus information about the encoded depth and the encoding mode can be set for the image data.
[00067] Thus, the entropy encoder 120 can assign encoding information about a corresponding encoded depth and an encoding mode to at least one of the encoding unit, the forecasting unit, and a minimum unit included in the maximum encoding unit. .
[00068] The minimum unit, according to an embodiment of the present invention, is a square-shaped data unit obtained, dividing the minimum coding unit, which constitutes the bottom depth, by 4. Alternatively, the Minimum unit can be a maximum square data unit, which can be included in all coding units, forecast units, partition units, and transformation units, included in the maximum coding unit.
[00069] For example, the coding information emitted through the entropy encoder 120 can be classified into coding information, according to coding units, and coding information, according to forecasting units. The encoding information, according to the encoding units, can include information about the forecast mode and the size of the partitions. The coding information, according to the forecast units, can include information about an estimated direction in an inter mode, about a reference image index of the inter mode, about a motion vector, about a chrominance component in a way intra, and about an interpolation method of the intra mode. In addition, information about a maximum encoding unit size, defined according to frames, slices, or a group of frames (GOP), and information about a maximum depth, can be inserted in a header of a bit stream.
[00070] In the video coding apparatus 100, the coding unit, according to depths, can be a coding unit obtained, dividing a height or width of a coding unit of a higher depth, which is a layer above, by two. In other words, when the size of the current depth coding unit is 2N x 2N, the size of the bottom depth coding unit is N x N. In addition, the current depth coding unit having the size of 2N x 2N can include a maximum number of four coding units for the bottom depth.
[00071] In this sense, the video encoding apparatus 100 can form the encoding units having the tree structure, determining encoding units having an ideal format and an ideal size for each maximum encoding unit, based on the size of the unit maximum coding and at the maximum determined depth, taking into account the characteristics of the current frame. In addition, since encoding can be performed on each maximum encoding unit, using any of the various prediction and transformation modes, an ideal encoding mode can be determined, considering the characteristics of the encoding unit of various image sizes. .
[00072] Thus, if an image with a high resolution or a large amount of data is encoded in a conventional macroblock, a number of macroblocks per frame increases excessively. Thus, a number of segments of compressed information, generated for each macroblock, increases and, thus, it is difficult to transmit the compressed information, and the efficiency of data compression decreases. However, using the video encoding apparatus 100, the efficiency of image compression can be increased, once an encoding unit is adjusted, while considering the characteristics of an image, by increasing a maximum size of an encoding unit, while considering an image size.
[00073] Fig. 2 is a block diagram of a video decoding apparatus 200, according to an embodiment of the present invention.
[00074] The video decoding apparatus 200 includes a symbol extraction unit 210, an entropy decoder 220, and a hierarchical decoder 230. Definitions of various terms, such as a coding unit, a depth, a prediction unit, a transformation unit, and information on the various encoding modes, for various operations of the video decoder apparatus 200, are identical to those described with reference to Fig. 1 and the video encoding apparatus 100.
[00075] The symbol extraction unit 210 receives and analyzes a bit stream from an encoded video. The entropy decoder 220 extracts encoded image data for each encoding unit of the analyzed bit stream, in which the encoding units have a tree structure, according to each maximum encoding unit, and sends the extracted image data to the hierarchical decoder 230. The entropy decoder 220 can extract information about the maximum size of an encoding unit of a current frame, from a header of the current frame.
[00076] In addition, the entropy decoder 220 extracts information about an encoded depth and an encoding mode for the encoding units having a tree structure, according to each maximum encoding unit, from the analyzed bit stream. The information extracted about the encoded depth and the encoding mode is output to the hierarchical decoder 230. In other words, the image data in a bit stream is divided into the maximum encoding unit, so that the hierarchical decoder 230 can decode the image data for each maximum encoding unit.
[00077] Information about the coded depth and the coding mode, according to the maximum coding unit, can be defined for information about at least one coding unit corresponding to the coded depth, and information about a coding mode can include information about a partition type of a coding unit corresponding to the coded depth, about a forecast mode, and a size of a transformation unit. In addition, division information, according to depths, can be extracted as information about the coded depth.
[00078] The information about the coded depth and the coding mode, according to each maximum coding unit extracted by the entropy decoder 220, is information about a coded depth and a coding mode, determined to generate a smaller coding error. , when an encoder, such as the video encoding apparatus 100, repeatedly performs encoding for each encoding unit, according to depths, according to each maximum encoding unit. In this sense, the video decoding apparatus 200 can restore an image, by decoding the image data, according to an encoded depth and an encoding mode, which generates the least encoding error.
[00079] Since the coding information about the coded depth and the coding mode can be assigned to a predetermined data unit out of a corresponding coding unit, a prediction unit, and a minimum unit, the entropy decoder 220 you can extract information about the encoded depth and the encoding mode, according to the predetermined data units. The predetermined data units, to which the same information about the coded depth and the coding mode are assigned, can be deduced as being the data units included in the same maximum coding unit.
[00080] Furthermore, as will be described later, when decoding the image data of the maximum encoding unit and symbols related to an encoding mode, according to depths, the entropy decoder 220 can perform entropy decoding by selecting a context model based on the hierarchical structure information of the hierarchically structured data unit, described above, and information on various information, as a color component different from the hierarchical structure.
[00081] The hierarchical decoder 230 restores the current frame, by decoding the image data in each maximum coding unit, based on the information on the coded depth and the coding mode, according to the maximum coding units. In other words, the hierarchical decoder 230 can decode the encoded image data, based on the extracted information about the partition type, the prediction mode, and the transformation unit for each encoding unit among the encoding units having the structure included in each maximum coding unit. A decoding process can include forecasting, including intra forecasting and motion compensation, and reverse transformation.
[00082] The hierarchical decoder 230 can perform intra forecast or motion compensation, according to a partition and forecast mode of each coding unit, based on information about the partition type and forecast mode of the forecast unit of the coding unit, according to coded depths.
[00083] In addition, the hierarchical decoder 230 can perform reverse transformation, according to each processing unit in the coding unit, based on information about the size of the processing unit of the coding unit, according to coded depths, according to order to perform the reverse transformation, according to maximum coding units.
[00084] The hierarchical decoder 230 can determine at least one coded depth of a maximum current coding unit, using division information, according to depths. If the split information indicates that image data is no longer divided at the current depth, the current depth is an encoded depth. In this sense, the hierarchical decoder 230 can decode the encoding unit of the current depth in relation to the image data of the current maximum encoding unit, using information about the partition type of the forecast unit, the forecast mode, and the size processing unit.
[00085] In other words, the data units containing the coding information including the same division information can be obtained, observing the defined coding information, assigned to the predetermined data unit among the coding unit, the forecasting unit, and the minimum unit, and the data units obtained can be considered as a data unit to be decoded by the hierarchical decoder 230 in the same encoding mode.
[00086] The video decoder 200 can obtain information about at least one encoding unit, which generates the smallest encoding error, when encoding is performed recursively for each maximum encoding unit, and can use the information to decode the current frame . In other words, image data encoded from the coding units having the tree structure determined, as the ideal coding units in each maximum coding unit, can be decoded.
[00087] Thus, even if the image data has a high resolution and a large amount of data, the image data can be efficiently decoded and restored, using a size of an encoding unit and an encoding mode, which are adaptably determined according to the characteristics of the image data, by means of information about an ideal encoding mode received from an encoder.
[00088] A method for determining coding units with a tree structure, a prediction unit, and a transformation unit, according to an embodiment of the present invention, will now be described with reference to Figures 3 to 13.
[00089] Fig. 3 is a diagram for describing a concept of coding units, according to an embodiment of the present invention.
[00090] A size of a coding unit can be expressed in width x height, and can be 64x64, 32x32, 16x16, and 8x8. A 64 x 64 encoding unit can be divided into 64 x 64, 64 x 32, 32 x 64, or 32 x 32 partitions; and a 32 x 32 encoding unit can be divided into 32 x 32, 32 x 16, 16 x 32, or 16 x 16 partitions; a 16 x 16 encoding unit can be divided into 16 x 16, 16 x 8, 8 x 16, or 8 x 8 partitions; and an 8x8 encoding unit can be divided into 8x8, 8x4, 4x8, or 4x4 partitions.
[00091] In video data 310, a resolution is 1920 x 1080, a maximum size of an encoding unit is 64, and a maximum depth is 2. In video data 320, a resolution is 1920 x 1080 , a maximum encoding unit size is 64, and a maximum depth is 3. In video data 330, a resolution is 352 x 288, a maximum encoding unit size is 16, and a depth maximum is 1. The maximum depth, shown in Fig. 3, indicates a total number of divisions, from a maximum coding unit to a minimum coding unit.
[00092] If a resolution is high, or the amount of data is large, a maximum size of a coding unit can be large, not only to increase the coding efficiency, but also to accurately reflect characteristics of an image. Thus, the maximum encoding unit size for video data 310 and 320, having a higher resolution than video data 330, can be 64.
[00093] Since the maximum depth of video data 310 is 2, encoding units 315 of video data 310 may include a maximum encoding unit having a long axis size of 64, and encoding units with axis sizes 32 and 16, since depths are raised in two layers, dividing the maximum coding unit twice. However, since the maximum depth of video data 330 is 1, encoding units 335 of video data 330 may include a maximum encoding unit having a long axis size of 16, and encoding units with an axis size over 8, since depths are elevated in one layer, dividing the maximum coding unit once.
[00094] Since the maximum depth of video data 320 is 3, encoding units 325 of video data 320 may include a maximum encoding unit having a long axis size of 64, and encoding units having axis sizes over 8, 16 and 32, since the depths are raised in 3 layers, dividing three times the maximum coding unit. When depth increases, detailed information can be precisely expressed.
[00095] Fig. 4 is a block diagram of a video encoder 400 based on encoding units having a hierarchical structure, according to an embodiment of the present invention.
[00096] An intra predictor 410 performs intra prediction in coding units in an intra mode, with respect to a current frame 405, and a motion estimator 420, and a motion compensator 425 perform inter estimate and motion compensation, respectively in coding units in an inter mode, using the current frame 405 and a reference frame 495.
[00097] Data emitted by the intra predictor 410, the motion estimator 420, and the motion compensator 425 are emitted as a quantized transformation coefficient, through a transformer 430 and a quantizer 440. The quantized transformation coefficient is reconstructed as data in a spatial domain, through an inverse quantizer 460 and an inverse transformer 470, and the reconstructed data in the spatial domain are emitted as the frame of reference 495, after being post-processed through an unlocking unit 480 and a filtering unit link 490. The quantized transformation coefficient can be output as a bit stream 455 through an entropy encoder 450.
[00098] When encoding the image data of the maximum encoding unit and symbols related to an encoding mode, according to depths, the entropy encoder 450 can perform entropy decoding, selecting a context model based on structure information hierarchical structure of the data unit structured in a hierarchical way, and various information, such as a color component different from the hierarchical structure.
[00099] In order for the video encoder 400 to be applied to the video encoding apparatus 100, all elements of the video encoder 400, that is, the intra predictor 410, the motion estimator 420, the motion compensator 425 , transformer 430, quantizer 440, entropy encoder 450, reverse quantizer 460, reverse transformer 470, unlocking unit 480 and link filtering unit 490 perform operations, based on each coding unit between units coding with a tree structure, considering the maximum depth of each maximum coding unit.
[000100] Specifically, the intra predictor 410, the motion estimator 420, and the motion compensator 425 determine partitions and a prediction mode for each coding unit between the coding units having a tree structure, taking into account the size maximum and maximum depth of a current maximum coding unit, and transformer 430 determines the size of the transformation unit in each coding unit among the coding units having a tree structure. In addition, the entropy encoder 450, according to the present embodiment, can perform entropy coding by selecting a context model used for entropy coding, based on hierarchical structure information from the hierarchically structured data unit. , and various information, such as a color component different from the hierarchical structure, according to the type of a corresponding symbol.
[000101] Fig. 5 is a block diagram of a video decoder 500, based on encoding units, according to an embodiment of the present invention.
[000102] An analyzer 510 analyzes encoded image data, to be decoded, and encoding information required for decoding, from a 505 bit stream. The encoded image data is output as inverse quantized data, using a decoder. entropy 520 and an inverse quantizer 530, and the inverse quantized data are reconstructed, forming image data in a spatial domain, through an inverse transformer 540.
[000103] An intra 550 predictor performs intra prediction in coding units in an intra mode, with respect to image data in the spatial domain, and a motion compensator 560 performs motion compensation in coding units in an inter mode, by means of of a 585 reference frame.
[000104] Image data in the spatial domain, which passed through the intra predictor 550 and the motion compensator 560, can be output as a restored frame, after being post-processed through an unlock unit 57 0 and a link filtering 580. In addition, the image data, which is post-processed via an unlocking unit 570 and a link filtering unit 580, can be output as the reference frame 585.
[000105] In order for the video decoder 500 to be applied to the video decoding apparatus 200, all elements of the video decoder 500, that is, the analyzer 510, the entropy decoder 520, the inverse quantizer 530, reverse transformer 540, intra predictor 550, motion compensator 560, unlocking unit 570, and link filtering unit 580, perform operations based on coding units with a tree structure for each maximum coding unit.
[000106] In particular, the intra predictor 550 and the motion compensator 560 determine a prediction mode and a partition for each coding unit having a tree structure, and the reverse transformer 540 must determine a size of a transformation unit for each coding unit. In addition, the entropy decoder 520, according to the present embodiment, can perform entropy decoding, selecting a context model used for entropy decoding of the encoded image data, which must be decoded, and symbols indicating coding information required for decoding, based on hierarchical structure information from the hierarchically structured data unit, and miscellaneous information, such as a color component different from the hierarchical structure, according to the type of a corresponding symbol.
[000107] Fig. 6 is a diagram illustrating the coding units, according to depths, and partitions, according to an embodiment of the present invention.
[000108] The video encoding apparatus 100 and the video decoding apparatus 200 use hierarchical encoding units in order to consider characteristics of an image. The maximum height, maximum width, and maximum depth of the coding units can be adaptably determined, according to the characteristics of the image, or they can be differently defined by a user. Sizes of the coding units, according to depths, can be determined, according to the maximum predetermined size of the coding unit.
[000109] In a hierarchical structure 600 of coding units, according to an embodiment of the present invention, the maximum height and the maximum width of the coding units are each 64, and the maximum depth is 4. Seen whereas a depth increases along a vertical axis of the hierarchical structure 600, a height and a width of the coding unit, according to depths, are each divided. In addition, a forecasting unit and partitions, which are the basis for forecasting coding for each coding unit, according to depths, are shown along a horizontal axis of the hierarchical structure 600.
[000110] In other words, a coding unit 610 is a maximum coding unit in hierarchical structure 600, where a depth is 0 and a size, that is, a height by width, is 64 x 64. The depth increases over of the vertical axis, with a coding unit 620 having a size of 32 x 32 and a depth of 1, a coding unit 630 having a size of 16 x 16 and a depth of 2, a coding unit 640 having a size of 8x8 and a depth of 3, and a coding unit 650 having a size of 4 x 4 and a depth of 4. The coding unit 650 having a size of 4 x 4 and the depth of 4 is a minimum coding unit.
[000111] The forecast unit and partitions of a coding unit are organized along the horizontal axis, according to each depth. In other words, if the encoding unit 610 having the size of 64x64 and the depth of 0 is a forecasting unit, the forecasting unit can be divided into partitions included in the encoding unit 610, that is, a partition 610 having a 64 x 64 size, 612 partitions having 64 x 32 size, 614 partitions having 32 x 64 size, or 616 partitions having 32 x 32 size.
[000112] Likewise, a prediction unit of the 620 encoding unit, having the size of 32 x 32 and the depth of 1, can be divided into partitions included in the 620 encoding unit, that is, a partition 620 having a size 32 x 32, partitions 622 having a size 32 x 16, partitions 624 having a size 16 x 32, and partitions 62 6 having a size 16 x 16.
[000113] Likewise, a prediction unit of the 630 encoding unit, having the size of 16 x 16 and the depth of 2, can be divided into partitions included in the encoding unit 630, that is, a partition having a size 16 x 16 partitions included in the 630 encoding unit, partitions 632 having a size of 16 x 8, partitions 634 having a size of 8 x 16, and partitions 636 having a size of 8 x 8.
[000114] Likewise, a forecast unit of the 640 encoding unit, having the size of 8 x 8 and the depth of 3, can be divided into partitions included in the 640 encoding unit, that is, a partition with a size 8 x 8 partitions included in the 640 encoding unit, 642 partitions having a size of 8 x 4, partitions 644 having a size of 4 x 8, and partitions 646 having a size of 4 x 4.
[000115] The coding unit 650, having the size of 4 x 4 and the depth of 4, is the minimum coding unit and a coding unit of the lowest depth. An encoding unit 650 forecast unit is only assigned to a partition having a size of 4 x 4.
[000116] To determine at least one coded depth of the coding units, which constitute the maximum coding unit 610, the hierarchical encoder 110 of the video coding apparatus 100 performs coding for coding units corresponding to each depth included in the coding unit maximum 610.
[000117] The number of coding units, according to depths, including data in the same range and the same size, increases with increasing depth. For example, four coding units corresponding to a depth of 2 are needed to cover data, which are included in a coding unit corresponding to a depth of 1. In this sense, in order to compare encoding results from the same data, according to with depths, the coding unit corresponding to the depth of 1 and four coding units corresponding to the depth of 2 are each coded.
[000118] To carry out coding for a current depth among the depths, a smaller coding error can be chosen for the current depth, by means of coding for each forecast unit in the coding units corresponding to the current depth, along the horizontal axis of the hierarchical structure 600. As an alternative, the smallest coding error can be searched for, comparing the smallest coding errors, according to depths, by coding for each depth, when the depth increases along the vertical axis of the structure hierarchical 600. A depth and partition with the lowest coding error in the 610 coding unit can be selected, such as the coded depth and a partition type of the 610 coding unit.
[000119] Fig. 7 is a diagram for describing a relationship between a coding unit 710 and transformation units 720, according to an embodiment of the present invention.
[000120] The video encoding apparatus 100 or the video decoding apparatus 200 encodes or decodes an image, according to encoding units with smaller or equal sizes, to a maximum encoding unit for each maximum encoding unit. Transformation unit sizes for transformation during coding can be selected based on data units, which are no larger than a corresponding coding unit.
[000121] For example, on the video encoding apparatus 100 or on the video decoding apparatus 200, if a size of the encoding unit 710 is 64 x 64, transformation can be performed, using transformation units 720 having a size 32x32.
[000122] In addition, data from the encoding unit 710, having the size of 64x64, can be encoded by means of transformation in each of the transformation units having the size of 32x32, 16x16, 8x8, and 4 x 4, which are smaller than 64 x 64 and then a transformation unit having the smallest coding error can be selected.
[000123] Fig. 8 is a diagram for describing coding information of the coding units corresponding to a coded depth, according to an embodiment of the present invention.
[000124] A transmitting unit 130 of the video encoding apparatus 100 can encode and transmit information 800 about a partition type, information 810 about a prediction mode, and information 820 about a size of a processing unit for each encoding unit corresponding to a coded depth, such as information about a coding mode.
[000125] Information 800 indicates information about a format of a obtained partition, dividing a forecast unit from a current encoding unit, where the partition is a data unit for forecast encoding from the current encoding unit. For example, a current encoding unit CU_0, having a size of 2N x 2N, can be divided into any one of a partition 802 having a size of 2NX2N, a partition 804 having a size of 2NxN, a partition 806 having a size of Nx2N, and an 808 partition having an NxN size. Here, information 800 about a partition type is defined, to indicate one among partition 804 having a size of 2NxN, partition 806 having a size of Nx2N, and partition 808 having a size of NxN.
[000126] Information 810 indicates a forecast mode for each partition. For example, information 810 may indicate a prediction encoding mode performed on a partition indicated by information 800, that is, an intra mode 812, an inter mode 814, or a hop mode 816.
[000127] Information 820 indicates a transformation unit to be based, when the transformation is carried out in a current coding unit. For example, the transformation unit can be a first intra 822 transformation unit, a second intra 824 transformation unit, a first inter 826 transformation unit, or a second inter 828 transformation unit.
[000128] The entropy decoder 220 of the video decoding apparatus 200 can extract and use information 800, 810 and 820 for decoding, according to each coding unit, according to depths.
[000129] Fig. 9 is a diagram of the coding units, according to depths, according to an embodiment of the present invention.
[000130] Division information can be used to indicate a change in depth. The split information indicates whether a coding unit of a current depth has been divided into coding units of a lower depth.
[000131] A forecast unit 910 for forecast encoding of an encoding unit 900, having a depth of 0 and a size of 2N_0x2N_0, can include partitions of a partition type 912 having a size of 2N_0x2N_0, a partition type 914 having a size of 2N_0xN_0, a partition type 916 having a size of N_0x2N_0, and a partition type 918 having a size of N_0xN_0. Fig. 9 only illustrates the partition types 912 to 918 obtained, dividing forecast unit 910 symmetrically, but a partition type is not limited by that aspect, and forecasting unit 910 partitions can include asymmetric partitions, partitions having a predetermined shape, and partitions having a geometric shape.
[000132] Forecast encoding is performed repeatedly on a partition having a size of 2N_0x2N__0, two partitions having a size of 2N_0xN_0, two partitions having a size of N_0x2N_0, and four partitions having a size of N OxN 0, according to each type of partition. Forecast coding in an intra and an inter mode can be performed on partitions with the sizes of 2N_0x2N_0, N_0x2N_0, 2N_0xN_0 and N_0xN_0. Prediction encoding in a jump mode is performed only on the partition with the size of 2N_0x2N_0.
[000133] If a coding error is the smallest of them in one of partition types 912 to 916 having the sizes of 2N_0 x 2N_0, 2N_0 x N_0, and N_0 x 2N_0, the forecast unit 910 cannot be divided into a depth bottom.
[000134] If the coding error is the smallest of them in partition type 918 having the size of N_0 x N_0, a depth is changed from 0 to 1, to divide partition type 918 in operation 920, and coding is performed in coding units of the partition type having a depth of 2 and a size of N_0 x N_0, to look for a minor coding error.
[000135] A forecast unit 940 for forecast encoding of the encoding unit (partition type) 930, having a depth of 1 and a size of 2N_lx2N_l (= N_0xN_0), can include partitions of a partition type 942 having a size of 2N_lx2N_l, a partition type 944 having a size of 2N_lxN_l, a partition type 94 6 having a size of N_lx2N_l, and a partition type 94 8 having a size of N_lxN_l.
[000136] If an encoding error is the smallest in partition type 948 having the size of N_1 x N_l, a depth is changed from 1 to 2, to divide partition type 948 in operation 950, and encoding is performed repeatedly on 960 coding units, which have a depth of 2 and a size of N_2 x N_2, to look for a smaller coding error.
[000137] When a maximum depth is d, a division operation, according to each depth, can be performed, even when a depth becomes d-1, and division information can be coded, even when a depth is one among 0 and d-2. In other words, when coding is performed, even when the depth is d-1, after a coding unit corresponding to a depth of d-2 is divided in operation 970, a forecast unit 990 for forecast coding of a unit encoding 980, having a depth of d-1 and a size of 2N_ (dl) x2N (d-1), can include partitions of a partition type 992 having a size of 2N_ (d-1) x2N_ (d-1 ), a partition type 994 having a size of 2N_ (d-1) xN_ (d-1), a partition type 996 having a size of N_ (d-1) x2N_ (d-1), and a type of partition 998 having a size of N_ (d-1) xN_ (d-1).
[000138] Forecast encoding can be performed repeatedly on one partition having a size of 2N (dl) x2N (d-1), on two partitions having a size of 2N_ (d-1) xN_ (d-1), in two partitions having a size of N_ (d-1) x2N_ (d-1), and in four partitions having a size of N_ (d-1) xN_ (d-1), among partition types 992 to 998, to search a partition type having a lower coding error.
[000139] Even when partition type 998 has the smallest coding error, since a maximum depth is d, a CU_ (dl) encoding unit having a depth of d-1 is no longer divided into a lower depth, and a coded depth for the coding units, constituting the current maximum coding unit 900, is determined to be d-1, and a partition type of the current maximum coding unit 900 can be determined, as being N_ (d-1 ) xN_ (d-1). In addition, since the maximum depth is d, division information for the minimum coding unit 980 is not defined.
[000140] A data unit 999 can be a 'minimum unit' for the current maximum encoding unit. A minimum unit, according to an embodiment of the present invention, can be a rectangular data unit obtained, by dividing a minimum encoding unit 980 by 4. When performing the encoding repeatedly, the video encoding apparatus 100 can select a depth having the smallest coding error, comparing coding errors, according to depths of the coding unit 900, to determine a coded depth, and define a partition type and a corresponding forecast mode, such as a coding mode for coded depth.
[000141] Therefore, the smallest coding errors, according to depths, are compared at all depths from 1 to d, and a depth having the smallest coding error can be determined as a coded depth. The encoded depth, the partition type of the forecast unit, and the forecast mode, can be encoded and transmitted as information about an encoding mode. In addition, since a coding unit is divided, from a depth of 0 to a coded depth, only division information of the coded depth is set to 0, and depth division information excluding the coded depth is set to 1.
[000142] The entropy decoder 220 of the video decoding apparatus 200 can extract and use information about the encoded depth and the prediction unit of the encoding unit 900 to decode the encoding unit 912. The video decoding apparatus 200 can determine a depth, where division information is 0, as an encoded depth, using division information, according to depths, and use information about a corresponding depth encoding mode for decoding.
[000143] Figs. 10 to 12 are diagrams for describing a relationship between coding units 1010, forecasting units 1060, and transformation units 1070, according to an embodiment of the present invention.
[000144] The coding units 1010 are coding units having a tree structure, corresponding to the coded depths, determined by the video coding apparatus 100, in a maximum coding unit. Forecasting units 1060 are partitions of forecasting units from each of the 1010 coding units, and transformation units 1070 are transformation units from each of the 1010 coding units.
[000145] When a depth of a maximum coding unit is 0 in coding units 1010, depths of coding units 1012 and 1054 are 1, depths of coding units 1014, 1016, 1018, 1028, 1050 and 1052 are 2, depths of coding units 1020, 1022, 1024, 1026, 1030, 1032 and 1048 are 3, and depths of coding units 1040, 1042, 1044 and 1046 are 4.
[000146] In the forecast units 1060, some coding units 1014, 1016, 1022, 1032, 1048, 1050, 1052 and 1054 are obtained by dividing the coding units. In other words, partition types on encoding units 1014, 1022, 1050 and 1054 have a size of 2NxN, partition types on encoding units 1016, 1048 and 1052 have a size of Nx2N, and a partition type of 1032 encoding has an NxN size. Forecasting units and partitions of the 1010 coding units are less than, or equal to, each coding unit.
[000147] Transformation or inverse transformation is performed on the image data of the 1052 encoding unit in the 1070 processing units, in a data unit that is smaller than the 1052 encoding unit. In addition, the 1014, 1016 encoding units , 1022, 1032, 1048, 1050 and 1052 in transformation units 1070 are different from those in forecast units 1060, in terms of sizes and shapes. In other words, the video encoding apparatus 100 and the video decoding apparatus 200 can perform intra prediction, motion estimation, motion compensation, transformation, and reverse transformation, individually in a data unit in the same encoding unit.
[000148] In this sense, coding is recursively performed in each of the coding units, having a hierarchical structure in each region of a maximum coding unit, to determine an ideal coding unit and, thus, coding units with a structure in recursive tree can be obtained. Encoding information can include division information about a coding unit, information about a partition type, information about a forecast mode, and information about a size of a transformation unit. Table 1 shows the encoding information, which can be set by the video encoding device 100 and the video decoding device 200. Table 1

[000149] Entropy encoder 120 of video encoding apparatus 100 can transmit encoding information about encoding units having a tree structure, and entropy decoder 220 of video encoding apparatus 200 may extract encoding information about coding units having a tree structure, from a received bit stream.
[000150] The division information indicates whether a current coding unit has been divided into lower depth coding units. If division information for a current depth d is 0, a depth, in which a current coding unit is no longer divided into a lower depth, is an encoded depth and thus information about a partition type, forecast mode, and a size of a transformation unit, can be defined for the coded depth. If the current coding unit is further divided, according to the division information, coding is carried out independently into four division coding units, of lower depth.
[000151] A prediction mode can be an intra mode, an inter mode, and a jump mode. The intra mode and the inter mode can be set on all partition types, and the jump mode is set only on a partition type having a size of 2Nx2N.
[000152] Partition type information can indicate symmetric partition types with sizes of 2Nx2N, 2NxN, Nx2N and NxN, which are obtained by symmetrically dividing a height or width of a forecast unit, and partition types asymmetric with sizes of 2NxnU, 2NxnD, nLx2N and nRx2N, which are obtained by dividing the height or width of the forecasting unit asymmetrically. The asymmetric partition types, having the sizes of 2NxnU and 2NxnD, can be obtained, respectively, by dividing the height of the forecast unit in l: nen: l (where n is an integer greater than 1), and the types Asymmetric partition patterns, having the sizes of nLx2N and nRx2N, can be obtained, respectively, by dividing the width of the forecast unit into l: nen: l.
[000153] The size of the transformation unit can be defined to be of two types in the intra mode, and of two types in the inter mode. In other words, if the transformation unit's split information is 0, the size of the transformation unit can be 2Nx2N, which is the size of the current coding unit. If transformation unit division information is 1, the transformation units can be obtained by dividing the current coding unit. In addition, if a partition type of the current coding unit, having the size of 2Nx2N, is a symmetric partition type, a size of a transformation unit can be NxN, and if the partition type of the current coding unit is an asymmetric partition type, the size of the transformation unit can be N / 2xN / 2.
[000154] Coding information about coding units with a tree structure can include at least one of the coding units corresponding to a coded depth, a forecasting unit, and a minimum unit. The coding unit corresponding to the coded depth can include at least one of the forecast unit and a minimum unit, which contains the same coding information.
[000155] In this sense, it is determined whether the adjacent data units are included in the same coding unit corresponding to the coded depth, comparing the coding information of the adjacent data units. In addition, a corresponding coding unit, corresponding to an encoded depth, is determined using the coding information from a data unit and, thus, a distribution of coded depths in a maximum coding unit can be determined.
[000156] Thus, if a current coding unit is provided based on coding information from the adjacent data units, coding information from the data units in coding units, according to depths adjacent to the current coding unit, can be directly referred to and used.
[000157] Alternatively, if a current coding unit is provided based on the coding information from the adjacent data units, data units adjacent to the current coding unit are searched, using coded information from the data units, and the units of adjacent encodings searched can be referred to to forecast the current encoding unit.
[000158] Fig. 13 is a diagram to describe a relationship between a coding unit, a forecasting unit, and a transformation unit, according to information on the coding mode in Table 1.
[000159] One of maximum coding unit 1300 includes coding units 1302, 1304 1306, 1312, 1314, 1316 and 1318 of coded depths. Here, since the encoding unit 1318 is a depth encoding unit, division information can be set to 0. Information about a partition type of the encoding unit 1318 having a size of 2Nx2N can be defined as being those among a type of partition 1322 having a size of 2Nx2N, a type of partition 1324 having a size of 2NxN, a type of partition 132 6 having a size of Nx2N, a type of partition 1328 having a size of NxN, a type of partition 1332 having a size of 2NxnU, a partition type 1334 having a size of 2NxnD, a partition type of 1336 having a size of nLx2N, and a partition type 1338 having a size of nRx2N.
[000160] When the partition type is defined to be symmetric, that is, the partition type 1322, 1324, 1326 or 1328, a 1342 transformation unit having a size of 2Nx2N is defined, if division information (size flag TU) of a transformation unit are 0, and a transformation unit 1344 having an NxN size is defined, if a TU size flag is 1.
[000161] When the partition type is defined as being asymmetric, that is, partition type 1332, 1334, 1336 or 1338, a 1352 transformation unit having a size of 2Nx2N is defined, if a TU size flag is 0 , and a transformation unit 1354 having a size of N / 2xN / 2 is defined, if a flag of size TU is 1.
[000162] The TU size flag is a type of transformation index; a size of a transformation unit corresponding to a transformation index can be modified, according to a type of forecasting unit or a partition type of a coding unit.
[000163] When the partition type is defined to be symmetric, that is, the partition type 1322, 1324, 1326 or 1328, the processing unit 1342 having a size of 2Nx2N is defined, if a TU size flag of a transformation unit is 0, and transformation unit 1344 having an NxN size is defined, if a TU size flag is 1.
[000164] When the partition type is defined as being asymmetric, that is, the partition type 1332 (2N x nU), 1334 (2N x nD), 1336 (nL x 2N), or 1338 (nR x 2N), transformation unit 1352 having a size of 2Nx2N is defined, if a flag of size TU is 0, and a transformation unit 1354 having a size of N / 2xN / 2 is defined, if a flag of size TU is 1.
[000165] Referring to Fig. 13, the TU size flag is a flag having a value of 0 or 1, but the TU size flag is not limited to 1 bit, and a transformation unit can be hierarchically divided, while the TU size flag increases from 0. The transformation unit division information (TU size flag) can be used as an example of a transformation index.
[000166] In this case, when a TU size flag, according to an embodiment, is used with a maximum size and a minimum size of a transformation unit, the size of the transformation unit actually used can be expressed. The video encoding apparatus 100 can encode size information of the maximum transformation unit, and size information of the minimum transformation unit, and division information of the maximum transformation unit. Maximum transformation unit size coded information, minimum transformation unit size information, and maximum transformation unit division information can be entered into a sequence parameter set (SPS). The video decoder apparatus 200 can use the maximum transformation unit size information, the minimum transformation unit size information, and the maximum transformation unit division information for video decoding.
[000167] For example, (a) if a current encoding unit size is 64 x 64 and a maximum transformation unit is 32 x 32, (a-1) a size of a transformation unit is 32 x 32, if a TU size flag is 0; (a-2) a size of a transformation unit is 16 x 16, if a TU size flag is 1; and (a-3) a size of a transformation unit is 8 x 8, if a TU size flag is 2.
[000168] Alternatively, (b) if a size of a current coding unit is 32 x 32 and a minimum transformation unit is 32 x 32, (b-1) a size of a processing unit is 32 x 32 , if a TU size flag is 0, and since the size of a transformation unit cannot be less than 32 x 32, no TU size flag can be further defined.
[000169] Alternatively, (c) if a current encoding unit size is 64 x 64 and a maximum TU size flag is 1, a TU size flag can be 0 or 1, and no other size flags TU can be more defined.
[000170] Thus, when defining a maximum TU size flag as 'MaxTransformSizelndex', a minimum TU size flag as 'MinTransformSize', and a transformation unit in the event that a TU size flag is 0, that is, a RootTu basic transformation unit as 'RootTuSize', a size of a minimal 'CurrMinTuSize' transformation unit, which is available in a current coding unit, can be defined by Equation (1): CurrMinTuSize = max (MinTransformSize, RootTuSize / ( 2AMaxTransformSizeIndex)) (1)
[000171] Compared to the size of the minimal transformation unit 'CurrMinTuSize', which is available in the current coding unit, the size of the basic transformation unit 'RootTuSize', which is a size of a transformation unit, when a flag of size TU is 0, it can denote a maximum transformation unit, which can be selected with respect to a system. That is, according to Equation (1), 'RootTuSize / (2AMaxTransformSizeIndex)' denotes a size of a transformation unit, which is obtained by dividing 'RootTuSize', which is a size of a transformation unit, when the division information of the transformation unit is 0, by the number of times of division corresponding to the division information of the maximum transformation unit, and 'MinTransformSize' denotes a size of a minimum transformation unit and, therefore, a smaller value among these can be 'CurrMinTuSize', which is the size of the minimum transformation unit, which is available in the current decoding unit.
[000172] According to an embodiment of the present invention, the size of the basic transformation unit 'RootTuSize' may vary, according to a forecast mode.
[000173] For example, if a current forecast mode is an inter mode, then 'RootTuSize' can be determined, using Equation (2) below. In Equation (2), 'MaxTransformSize' denotes a size of the maximum transformation unit, and 'PUSize' denotes a size of the current forecasting unit. RootTuSize = min (MaxTransformSize, PUSize) (2)
[000174] That is, if a current forecast mode is an inter mode, the size of the basic transformation unit 'RootTuSize', which is a transformation unit, if a TU size flag is 0, it can be defined as a smaller value between the size of the maximum transformation unit and the size of the current forecasting unit.
[000175] If a prediction mode for a current partition drive is an intra mode, 'RootTuSize' can be determined, using Equation (3) below. 'Partitionsize' denotes a size of the current partition unit. RootTuSize = min (MaxTransformSize, Partitionsize) (3)
[000176] That is, if a current forecast mode is an intra mode, the size of the basic transformation unit 'RootTuSize' can be defined as a smaller value among the size of the maximum transformation unit and the size of the current partition unit .
[000177] However, it should be noted that the size of the basic transformation unit 'RootTuSize', which is the size of the current maximum transformation unit, according to an embodiment of the present invention, and varies according to a mode prediction of a partition unit is an example, and factors to determine the size of the current maximum transformation unit are not limited by this aspect.
[000178] Hereinafter, an entropy encoding operation of a symbol, which is performed on the entropy encoder 120 of the video coding apparatus 100 of Fig. 1, and an entropy decoding operation of a symbol, which is performed on the entropy decoder 220 of the video decoder apparatus 200 of Fig. 2, will be described in detail.
[000179] As described above, the video encoding apparatus 100 and the video decoding apparatus 200 perform encoding and decoding, dividing a maximum encoding unit into encoding units, which are less than or equal to a maximum encoding unit. A forecasting unit and a transformation unit used in forecasting and transformation can be determined based on costs, independently of other data units. Since an ideal coding unit can be determined by recursive coding of each coding unit, having a hierarchical structure included in the maximum coding unit, data units with a tree structure can be configured. In other words, for each maximum coding unit, a coding unit having a tree structure, and a forecasting unit and a transformation unit having each tree structure can be configured. For decoding, hierarchical information, which is information that indicates the structure information of data units with a hierarchical structure, and non-hierarchical information for decoding other than hierarchical information, needs to be transmitted.
[000180] Information related to a hierarchical structure is information necessary for determining a coding unit having a tree structure, a forecasting unit having a tree structure, and a transformation unit having a tree structure, as described above with reference to Figs. 10 to 12, and include a size of a maximum coding unit, coded depth, partition information of a forecasting unit, a division flag, which indicates whether a coding unit has been divided or not, information about the size of a transformation unit, and a transformation unit division flag, "TU size flag", which indicates whether or not a transformation unit has been split. Examples of information encoding information from non-hierarchical structure include information from the intra and inter forecast mode applied to each forecast unit, motion vector information, forecast direction information, color component information applied to each unit data, if a plurality of color components are used, and texture information, as a transformation coefficient.
[000181] Fig. 14 is a block diagram, illustrating a structure of an entropy coding apparatus 1400, according to an embodiment of the present invention. The entropy coding apparatus 1400 of Fig. 14 corresponds to the entropy encoder 120 of the video coding apparatus 100 of Fig. 1. The entropy coding apparatus 1400 performs the entropy coding of symbols, indicating information related to a structure hierarchical, which is a coding destination and coding information, other than information from a hierarchical structure.
[000182] Referring to Fig. 14, the entropy coding apparatus 1400, according to the current embodiment, includes a context modeling unit 1410, a probability estimator 1420 and a normal encoder 1430. The unit of context modeling 1410 determines a context model used for entropy encoding a symbol based on hierarchical information from a data unit, to which a symbol of a coded frame belongs. In detail, supposing that hierarchical information related to the hierarchical data structure unit, to which a currently encoded target symbol belongs, has a number I of state values, where I is a positive integer, the context modeling unit 1410 can define I or a smaller number of context models, according to a state value of hierarchical information, and can determine a context model to be used for encoding a current symbol, by assigning a context index, indicating one of I or a smaller number of context models, according to the state value of the hierarchical information. For example, the size of a data unit, to which the currently encoded destination symbol belongs, has a total of five state values of 2 x 2, 4 x 4, 8 x 8, 16 x 16, 32 x 32 and 64 x 64. Assuming that the above data unit sizes are used as hierarchical information, the 1410 context modeling unit can define five or fewer context models, depending on the size of the data unit, and can determine a context index, indicating a context model to be used for the entropy encoding of a current symbol based on the size of a data unit, to which the current symbol belongs.
[000183] In addition to the absolute data unit size information, as described above, relative hierarchical information, which indicates a relative size of a data unit, to which a symbol belongs in relation to a larger data unit, can be used . For example, when a current data unit is a data unit having an N x N size, which is separate from a larger data unit having a size of 2N x 2N, the size of a data unit, to which the current symbol, can be determined by means of a division flag, indicating whether or not a larger data unit, having a size of 2N x 2N, has been divided. Thus, the context modeling unit 1410 can determine the size of a data unit, to which a current symbol belongs, using the division flag indicating information about the size of a larger data unit, and whether the largest data unit it was divided or not and then determine a context model, which is applicable to the current symbol, based on information about the size of the given data unit. In addition, information, which indicates a relationship between the size of a data unit, to which the current symbol belongs, and the size of a larger data unit, can be used as hierarchical information. For example, when a current data unit has a size in a ratio of 1/2 of the largest data unit having a size of 2N x 2N, a size of N x N, which is the size of a data unit, to which the current symbol belongs, it can be determined from the information in the list above. Thus, the context modeling unit 1410 can determine the size of a data unit, to which a current symbol belongs, using relative hierarchical information, which indicates a relative size of a data unit, to which the current symbol belongs, in relation to the largest data unit, such as hierarchical information, and then determine a context model based on the determined size of the data unit.
[000184] In addition, the context modeling unit 1410 can determine a context model used for entropy encoding a target symbol based on a combination of hierarchical information and additional information, other than hierarchical information, of according to the type of a destination symbol subject to entropy coding. In detail, supposing that hierarchical information related to the hierarchical structure data unit, to which a currently encoded destination symbol belongs, has number I of state values, and other non-hierarchical information, other than hierarchical information, has number J of state values, where J is a positive integer, the number of cases available for hierarchical information and non-hierarchical information is a total of I x J. The 1410 context modeling unit can define I x J or a smaller number of context models, according to a combination of the number I xj of state values, and determine a context model to be used for the encoding of a current symbol, by assigning a context index indicating one among I xj or a smaller number of context models, according to the hierarchical information of a data unit, to which a current symbol and a state value of non-hierarchical information belong. For example, a case is assumed in which information about the size of a data unit, to which a symbol with a total of five status values of 2 x 2, 4x4, 8x8, 16 x 16, 32 x belongs 32 and 64 x 64, be used as the color component information, and hierarchical information from a data unit, to which a symbol having two status values of a luminance component and a chrominance component belongs, be used as the non-hierarchical information. In this case, a total of 5 x 2, that is, 10, combinations are possible, such as the status values of hierarchical information and non-hierarchical information. The context modeling unit 1410 defines ten or fewer context models corresponding to the ten state value combinations, and determines and issues a context index determined according to a state value related to a current symbol.
[000185] The context modeling unit 1410, is not limited to the example above, being able to select from the plurality of context models, by combining several ways of hierarchical information and non-hierarchical information, according to the type of a symbol encoded. In other words, n segments of hierarchical information and non-hierarchical information, where n is an integer, are used to determine a context model. Assuming that n-segments of hierarchical information and non-hierarchical information, each having Si number of state values, where Si is an integer and i is an integer from 1 to n, the context modeling unit 1410 can determine and issue a context index, indicating a plurality of context models corresponding to the SixSiX ... x Sn number of state value combinations, based on a state value related to the currently encoded symbol. The number Si> <S2x ... x Sn of state value combinations is grouped and therefore SiSix. . . x Sn or a smaller number of context models can be used.
[000186] Referring again to FIG. 14, the probability estimator 1420 determines and displays information about a binary signal corresponding to the most likely symbol (MPS) and a less likely symbol (LPS) between binary 0 and 1 signals, and information on the probability value over MPS or LPS, using the context index information issued by the context modeling unit 1410. An MPS or LPS probability value can be determined by reading a probability value indicated by a context index from a predefined lookup table. In addition, the MPS and LPS probability values can be updated, based on an accumulation value for the occurrence of a binary signal.
[000187] The normal encoder 1430 performs the entropy coding and emits a current symbol based on information from the probability value and information from the binary signal corresponding to MPS or LPS.
[000188] The entropy encoding apparatus 1400 can encode each symbol by a variable length encoding method to assign a predefined code word, according to a combination of hierarchical and non-hierarchical information, in addition to an arithmetic encoding method context-adaptive binary (CABAC), whereby a symbol is encoded based on the probability values of MPS and LPS.
[000189] A process for executing symbol entropy coding using context modeling based on hierarchical information is described below. In detail, a process for performing entropy coding of a symbol related to a transformation coefficient, a symbol with a hierarchical structure of a transformation unit, and a symbol of coding units with a hierarchical structure, is described in detail.
[000190] Fig. 15 illustrates a hierarchically structured data unit and division information of the hierarchically structured data unit, according to an embodiment of the present invention. In the following description, a data unit is assumed to be a transformation unit.
[000191] As described above, according to the present embodiment, coding is performed using the coding unit, the forecasting unit, and the transformation unit, with a hierarchical structure. In Fig. 15, a transformation unit 1500 having a level N * N size 0, which is the highest level, is divided into transformation units 31a, 31b, 31c, and 31d level 1, which is a level lower, which is at a lower level than the uppermost level. Some level 1 transformation units 31a and 31d, each of which is divided into transformation units 32a, 32b, 32c, 32d, 32e, 32f, 32g, and 32h of level 2, which is an immediate lower level. A transformation unit division flag "TU size flag", which indicates whether each transformation unit has been divided into transformation units of an immediate lower level, can be used as a symbol to indicate a hierarchical structure of a transformation unit . For example, when the TU size flag for a current transformation unit is 1, it can show that the current transformation unit has been divided into lower level transformation units. When the TU size flag for a current transformation unit is 0, it can show that the current transformation unit is no longer split.
[000192] When the transformation units 31a, 31b, 31c, 31d, 32a, 32b, 32c, 32d, 32e, 32f, 32g, and 32h, which were divided from the level 0 transformation unit, form a hierarchical structure , transformation unit division information for each transformation unit can form a hierarchical structure. In other words, division information for transformation unit 33 with a hierarchical structure includes division information for transformation unit 34 of the highest level 0, division information for transformation unit 35a, 35b, 35c and 35d of level 1, and processing unit division information 36a, 36b, 36c, 36d, 36e, 36f, 36g, 36h level 2.
[000193] From the division information of the transformation unit 33 with a hierarchical structure, the division information of the transformation unit 34 of level 0 can indicate that the transformation unit of the highest level 0 has been divided. Similarly, the division information for level 1 transformation unit 35a and 35d, each of which can denote that level 1 transformation units 31a and 31d have been divided into transformation units 32a, 32b, 32c, 32d, 32e, 32f, 32g, and 32h level 2
[000194] Some level 1 transformation units 31b and 31c are no longer divided, and correspond to a leaf node having no child nodes in a tree structure. Likewise, level 2 transformation units 32a, 32b, 32c, 32d, 32e, 32f, 32g and 32h correspond to leaf nodes, which are no longer divided into lower level transformation units.
[000195] Therefore, the TU size flag, indicating whether a higher level transformation unit has been divided into a lower level transformation unit, can be used as a symbol that indicates a hierarchical structure of a transformation unit .
[000196] When the TU size flag, indicating the hierarchical structure of a transformation unit, is encoded by entropy, the video coding apparatus 100, according to the present embodiment, can entropy the size flags by entropy TU of all nodes, or just the TU size flag of a leaf node having no child nodes.
[000197] Figures 16 and 17 are reference views, illustrating symbols indicating a hierarchically structured data unit, according to an embodiment of the present invention. In Figs. 16 and 17, a flag is considered to be a TU size flag, which indicates whether a transformation unit of each node has been divided into a lower level transformation unit in a tree structure of the transformation unit's split information 33 of Fig. 15. Referring to Fig. 16, the video encoding apparatus 100, according to the present embodiment, which is a symbol, indicating a hierarchical structure of a transformation unit, can perform encoding by entropy of all information from the flag of the flagO transformation unit, flagla, flaglb, flaglc, flagld, flag2a, flag2b, flag2c, flag2d, flag2e, flag2f, flag2g and flag2h, with respect to transformation units 30, 31a, 31b, 31c, 31d, 32a, 32b, 32c, 32d, 32e, 32f, 32g and 32h of all levels, as a symbol, indicating a hierarchical structure of a processing unit. In addition, as shown in Fig. 17, the video encoding apparatus 100 can entropy encode only information from the division flag of the flaglb, flaglc, flag2a, flag2b, flag2c, flag2d, flag2e, flag2f, flag2g and flag2h flag2h of transformation units corresponding to the leaf node having no child nodes. This is due to the fact that the division of a transformation unit from a higher level can be determined, according to the existence of information from the division flag of the transformation unit from a lower level. For example, in Fig. 17, when division flags of transformation unit flag2a, flag2b, flag2c and flag2d of transformation units 36a, 36b, 36c and 36d of level 2 exist, the transformation unit 35a of level 1, which is a higher level of level 2 transformation units 36a, 36b, 36c and 36d is necessarily divided into level 2 transformation units, which are lower levels, so that the transformation unit's splitting flag information is flagged from the level 1 transformation unit 35a need not be coded separately.
[000198] The video decoder apparatus 200, in accordance with the present embodiment, can extract and read all division flags of the flagO, flagla, flaglb, flaglc, flagld, flag2a, flag2b, flag2c, flag2d, flag2e, flag2f, flag2g and flag2h, with respect to processing units 30, 31a, 31b, 31c, 31d, 32a, 32b, 32c, 32d, 32e, 32f, 32g and 32h of all levels, according to a method of hierarchical symbol decoding, thus determining a hierarchical structure of a transformation unit. In addition, when only the division flags of the transformation unit flaglb, flaglc, flag2a, flag2b, flag2c, flag2d, flag2e, flag2f, flag2g and flag2h, with respect to transformation units 31b, 31c, 32a, 32b, 32c , 32d, 32e, 32f, 32g and 32h corresponding to the leaf node, are encoded, the video decoder apparatus 200, in accordance with the present embodiment, determines the other division flags of the flagO, flagla, flaglb transformation unit, flaglc and flagld, based on the transformation unit division flags extracted from flaglb, flaglc, flag2a, flag2b, flag2c, flag2d, flag2e, flag2f, flag2g and flag2h, thus determining the hierarchical structure of a transformation unit.
[000199] As described above, context modeling unit 1410 can determine one of the plurality of context models to entropy encode a transformation unit division flag, indicating the hierarchical structure of a transformation unit based on a state value, according to hierarchical information, or a combination of hierarchical information and non-hierarchical information.
[000200] Specifically, the context modeling unit 1410 can determine a context model used for entropy coding of a division flag of the current transformation unit, based on the hierarchical information of a transformation unit, to which the flag belongs. division of the current processing unit to be coded.
[000201] Fig. 19 illustrates an example of context indexes for determining a context model based on the size of a data unit, according to an embodiment of the present invention. Referring to Fig. 19, the context modeling unit 1410 can determine a context model for entropy encoding a flag of the current transformation unit, by assigning one of the context indexes indicating a plurality of predefined context models , based on information about a size of a transformation unit, to which the current transformation unit flag belongs. For example, when the size of a transformation unit, to which the current transformation unit flag belongs, is 16 x 16, a context model with a context index value of 6 is selected.
[000202] Fig. 20 is a reference view, illustrating a contextual model, according to an embodiment of the present invention. As described above, the probability estimator 1420 determines and issues information about a binary signal corresponding to the MPS and LPS of binary signals of "0" and "1", and information about a probability value of MPS or LPS, using information from the index of context issued by the context modeling unit 1410. Referring to Fig. 20, the probability estimator 1420 includes a plurality of probabilities of occurrence of binary signals in the form of a lookup table, and changes in a probability of occurrence of a binary signal, according to a currently encoded symbol and a surrounding situation, and emits information on the probability value determined for the normal encoder 1430. Specifically, when receiving a context index Index NO., indicating a context model to be applied to a current symbol of the context modeling unit 1410, the probability estimator 1420 can determine a pStateldx index of a probability table occurrence corresponding to an Index NO context index. corresponding signal and a binary signal corresponding to the MPS.
[000203] Fig. 21 is a graph of a probability value for the occurrence of MPS, according to an embodiment of the present invention. An occurrence probability table indicates an MPS probability value. When a pStateldx index of an occurrence probability table is allocated, a corresponding MPS probability value is determined. For example, when the context modeling unit 1410 determines an index value of a context model used for encoding a current symbol, such as 1, and outputs the determined value, the probability estimator 1420 determines a pStateldx value of 7 and an MPS value of 0 corresponding to the context index 1 of the context models in Fig. 20. In addition, the probability estimator 1420 determines an MPS probability value corresponding to pStateldx = 7 among the MPS probability values predefined, according to the pStateldx value. Since the sum of the probability values of MPS and LPS is 1, if a probability value of one of the MPS and LPS is known, a probability value of the remaining binary signal can be determined.
[000204] The probability estimator 1420 can update the probability values of MPS and LPS, considering statistics of the occurrence of a binary signal, updating the value of pStateldx, according to the fact that MPS or LPS is coded, whenever a single binary is encoded by the normal encoder 1430. For example, the probability estimator 1420, considering a result of encoding by the normal encoder 1430, can define transIdxMPS, which is a pStateldx value after the update, when MPS is encoded, and tranldxLPS, which is a pStateldx value after the update, when LPS is coded, in the form of a predetermined lookup table. Then, the 1420 probability estimator can change the MPS probability value by updating the pStateldx value for each encoding.
[000205] The normal encoder 1430 performs the entropy coding and emits a binary signal corresponding to a current symbol based on the information on a probability value and on the information on a binary signal corresponding to MPS or LPS.
[000206] Fig. 26 is a diagram for describing a binary arithmetic coding process, performed by the normal encoder 1430 of Fig. 14. In Fig. 26, the TU size flag indicating the hierarchical structure of a unit is assumed of transformation is a binary value "010" and probabilities of occurrence of 1 and 0 are 0.2 and 0.8, respectively. Here, the probability of occurrence of 1 and 0 is determined based on the hierarchical information of a transformation unit, for example, information about the size of a transformation unit, to which a current TU size flag belongs.
[000207] Referring to Fig. 26, when an initial binary value "0" of a value "010" is encoded, a section [0.0 ~ 0.8], which is an 80% lower portion of a initial section [0.0 ~ 1.0], is updated to a new section. Then, when a next torque value "1" is encoded, a section [0.64 ~ 0.8], which is a 20% higher portion of the section [0.0 ~ 0.8], is updated to a new section. When a next "0" is encoded, a section [0.64 ~ 0.768], which is an 80% lower portion of the section [0.64 ~ 0.8], is updated to a new section. In a binary number "0.11", which corresponds to a real number "0.75", which belongs to a final section [0.64 ~ 0.768], "11", which is the decimal part of 0.11, it is output as a bit stream corresponding to the binary "010" value of the TU size flag.
[000208] When a context model for entropy encoding a TU size flag based on information about the size of a transformation unit is determined, the context modeling unit 1410 can group the sizes of a transformation unit and define a context index to determine a context model, as shown in Fig. 22.
[000209] The context modeling unit 1410 can use relative hierarchical information, which indicates a relative size of a data unit, to which a symbol belongs in relation to a larger transformation unit, other than unit size information. absolute transformation. For example, a current transformation unit is a transformation unit having a size of a ratio of 1/2 with respect to a larger transformation unit having a size of 2N x 2N, the context modeling unit 1410 can determine, the from the relation information, a transformation unit, to which a current TU size flag belongs, to have a size of N * N, and determines a context model, based on the determined size of a transformation unit.
[000210] The context modeling unit 1410 can determine a context model used for entropy encoding a TU size flag, based on a combination of hierarchical information and additional information, other than hierarchical information, according to the type of a destination symbol to be encoded by entropy.
[000211] Fig. 25 is a reference view, illustrating the determination of a context index based on a combination of hierarchical information and additional information, other than hierarchical information, in accordance with an embodiment of the present invention. . Referring to Fig. 25, the context modeling unit 1410 defines a context index, indicating one of a plurality of context models, according to a combination of first information segments pl to pl having number I of values of state, where I is an integer, and segments of second information ql to qj having number J of state values, where J is an integer, and determines and issues a context index, according to the first information and second information related to a currently encoded symbol. For example, when information about the size of a data unit, to which a symbol, having a total of five state values 2 x 2, 4 x 4, 8 x 8, 16 x 16, 32 x 32 and 64 x 64, be used as the first information, and color component information having two state values of a luminance component and a chrominance component are used as the non-hierarchical information, ten combinations are available and the context modeling unit 1410 defines ten or a smaller number of context models corresponding to the ten combinations of state value, and determines and issues a determined context index, according to a state value related to a current symbol. In addition, the context modeling unit 1410 can group the state values, as in Fig. 22, to define a context index, according to the grouped state values.
[000212] Therefore, the context modeling unit 1410, according to the present embodiment, can select one of the plurality of context models, combining, in a variable way, hierarchical information and non-hierarchical information, according to with the type of a symbol to be encoded.
[000213] The process of encoding a symbol described above to indicate a hierarchical structure of a processing unit can be applied in the same way as a process of encoding a symbol, which indicates a hierarchical structure of a coding unit, or of a forecast unit. A division flag, indicating whether each coding unit has been divided into coding units of an immediate lower level, can be used as a symbol to indicate a hierarchical structure of a coding unit. In the same way as for entropy coding of a TU size flag described above, the division flag is entropy coded, based on a selected context model, according to a state value obtained, combining, variable form, hierarchical and non-hierarchical information.
[000214] A process of entropy coding of a symbol related to a transformation coefficient is described below. Fig. 18 is a reference view for describing an entropy coding process for a transformation coefficient, according to an embodiment of the present invention.
[000215] A symbol related to transformation coefficients, transformed based on the hierarchical structures of transformation units, includes a "coded_block flag" flag, which indicates whether a transformation coefficient value other than 0 exists in the transformation coefficients included in the unit transformation, a "significant coeff_flag" flag, which indicates the position of a transformation coefficient other than 0, a "last_significant_coeff_flag" flag, which indicates the position of a final transformation coefficient other than 0, and an absolute value of the transformation other than 0.
[000216] When the coded_block_flag flag is 0, which is the case where a transformation coefficient other than 0 does not exist in a current transformation unit, it means that there is no more information to be transmitted. A coded_block_flag flag, having a binary value of 0 or 1, is determined for each transformation unit. The coded_block_flag flag can be encoded by entropy, in the same way as for the TU size flag indicating the hierarchical structure of a transformation unit in Fig. 15. When the coded_block_flag flag of a transformation unit corresponding to an upper node is 0, the coded_block_flag flags of a transformation unit corresponding to a child node all have a value of 0 and, therefore, only the coded_block__f lag flag of a higher node is encoded by entropy.
[000217] Referring to Fig. 18, transformation coefficients in a 2000 transformation unit are checked, according to a zigzag scanning order. The scan order can be changed. In Fig. 18, all transformation coefficients corresponding to an empty space are assumed to be 0. In Fig. 18, a final effective transformation coefficient is a transformation coefficient 2010 having a value of "-1". During the scanning of each transformation coefficient in transformation unit 2000, the entropy coding apparatus 1400 encodes the "significant coeff flag" flag, which indicates whether each transformation coefficient is a transformation coefficient other than 0, and the " last_significant_coeff_flag ", which indicates whether the transformation coefficient other than 0 is a transformation coefficient other than 0 in a final position in the verification order. In other words, when the significant coeff flag is 1, the transformation coefficient at the corresponding position is an effective transformation coefficient, having a value other than 0. When the significant coeff flag is 0, the transformation coefficient at the corresponding position is an effective transformation coefficient, having a value of 0. When the last_significant_coeff_flag flag is 0, a subsequent effective transformation coefficient remains in the check order. When the last — significant_coeff_flag flag is 1, the transformation coefficient at the corresponding position is a final effective transformation coefficient. To indicate the position of a final effective transformation coefficient, coordinate information indicating a relative position of a final effective transformation coefficient can be used instead of the last_significant_coeff_flag flag. For example, as illustrated in Fig. 18, since the transformation coefficient "-1" 2010, as a final effective transformation coefficient, is located in the fifth position in the direction of the horizontal axis, and in the fifth position in the direction of the axis vertical in relation to the transformation coefficient, in the upper left position in Fig. 18, the entropy coding device 1400 can encode a value of x = 5 and y = 5, as position information for a final effective transformation coefficient.
[000218] Context modeling unit 1410 can determine a context model for entropy coding of symbols related to a transformation coefficient based on a state value, according to hierarchical information or a combination of hierarchical information and non-hierarchical information -hierarchical. In other words, just as for the process for determining a context model used for entropy encoding a TU size flag indicating the above-described hierarchical structure of a transformation unit, the context modeling unit 1410 can determine a context model used for entropy coding of symbols related to a transformation coefficient, based on the hierarchical information of a transformation unit, to which a current transformation coefficient to be coded belongs. For example, as illustrated in Fig. 19 or 22, the context modeling unit 1410 can determine a context model used for entropy coding of symbols related to a transformation coefficient, using information about the size of a transformation unit. , to which a current transformation coefficient belongs.
[000219] Furthermore, the context modeling unit 1410 can use relative hierarchical information, which indicates a relative size of a data unit, to which the symbol belongs in relation to a larger transformation unit, other than the information of size of the absolute transformation unit. The context modeling unit 1410 can determine a context model used for entropy coding of symbols related to a transformation coefficient, based on a combination of hierarchical information and additional information, other than hierarchical information. For example, context modeling unit 1410 can define a context index, based on information about the size of a transformation unit and color component information, such as non-hierarchical information. In addition, the context modeling unit 1410 can use information about the position of each pixel, such as non-hierarchical information for entropy encoding a symbol defined in units of pixels, such as the "significant_coeff_flag" flag, which indicates whether a transformation coefficient is a transformation coefficient other than 0 and the flag "last_significant_coeff_flag", which indicates whether the transformation coefficient other than 0 is the transformation coefficient other than 0 in the final position of the check order.
[000220] Fig. 23 and 24 are reference views, illustrating a context index mapping table defined based on information about the position of a data unit, according to an embodiment of the present invention. Referring to Figs. 23 and 24, the context modeling unit 1410 can assign a context index, as indicated by reference numbers 2500 and 2600, according to the position of each pixel during the entropy encoding of a symbol defined in units of pixels, and you can determine a context model using the context index determined according to the position of a current symbol. In addition, the context modeling unit 1410 can determine a context model through a combination of hierarchical information during entropy coding of a symbol defined in units of pixels. For example, the "significant_coeff_flag" flag, which indicates whether a transformation coefficient is a transformation coefficient other than 0, and the "last_significant_coeff_flag" flag, which indicates whether the transformation coefficient other than 0 is a transformation coefficient other than 0 in a final position in the scan order, they can be determined by combining the first information, according to the size of a transformation unit, and the second information, according to the position of a transformation coefficient. As illustrated in Fig. 25, the context modeling unit 1410 can define a context index, indicating one of a plurality of context models, according to a combination of segments of the first information pl to pl having number I of values of state, where I is an integer, and segments of the second information ql to qJ having number J of state values, where J is an integer and can determine and issue a context index, according to the size information of a transformation unit, to which a current transformation coefficient belongs, and the position of the current transformation coefficient.
[000221] Although symbols are encoded and decoded using CABAC in the description above, the entropy encoding apparatus 1400 can encode each symbol by a variable length encoding method, in which predefined code words are assigned according to a combination of information hierarchical and non-hierarchical.
[000222] The entropy coding apparatus 1400, according to the present embodiment, is not limited to the above description, being able to determine one among the plurality of context models through a combination of at least selected information among hierarchical information of a coding unit, hierarchical information from a forecasting unit, hierarchical information from a processing unit, color component information, forecasting mode information, the maximum size of a coding unit, coded depth, partition information a forecast unit, a split flag that indicates whether a coding unit has been split, information about the size of a transformation unit, a TU size flag, which indicates whether a transformation unit has been split, information about forecast mode intra / inter applied to each forecast unit, motion vector information, forecast direction, and information related to the position of a symbol, and perform entropy coding on a symbol using the given context model.
[000223] Fig. 27 is a flowchart of a video encoding method using a hierarchically structured data unit, in accordance with an embodiment of the present invention. Referring to Fig. 27, in operation 2910, hierarchical encoder 110 encodes a frame forming a video based on a hierarchically structured data unit. In the process of coding a table based on the hierarchically structured data unit, a hierarchically structured coding unit corresponding to each depth, coding units, according to a tree structure, including depth coding units. code depth, a partition for prediction coding for each coding unit of the coded depth, and hierarchical structure of a transformation unit, can be determined for each maximum coding unit.
[000224] In operation 2920, entropy encoder 120, which determines a context model used for entropy encoding of a symbol, is determined based on the hierarchical information of a data unit, to which a frame symbol belongs. encoded. In addition, entropy encoder 120 can determine a context model to be applicable to a current symbol of a plurality of context models through a combination of information related to a hierarchical structure and additional information, other than the structure information hierarchical.
[000225] Hierarchical information can be one of the information about the size of a data unit, to which a symbol belongs, and relative hierarchical information, which indicate a relative size of a data unit, to which a symbol belongs in relation to a higher level data unit having a size larger than the data unit to which the symbol belongs. Relative hierarchical information can include information about the size of a larger data unit, a division flag, indicating whether the largest data unit has been divided, or information about a relative relationship of data size, to which a symbol belongs with respect to the largest data unit.
[000226] In operation 2930, the entropy encoder 120 performs the entropy encoding of a symbol, using the given context model. The symbol can include information about a transformation coefficient, information about the hierarchical structure of a transformation unit used for coding, using the hierarchically structured data unit, and information about a hierarchical structure of a frame.
[000227] Fig. 28 is a block diagram, which illustrates a structure of an entropy decoding apparatus 3000, according to an embodiment of the present invention. The entropy decoding apparatus 3000 of Fig. 28 corresponds to the entropy decoder 220 of the video decoding apparatus 200 of Fig. 2.
[000228] The entropy decoding apparatus 3000 entrypically decodes symbols indicating information related to the hierarchical structure, which is an encoding destination extracted by the symbol extraction unit 210 of Fig. 2, and encoding information different from the hierarchical structure information . Referring to FIG. 28, the entropy decoding apparatus 3000, according to the current embodiment, includes a context modeling unit 3010, a probability estimator 3020, and a normal decoder 3030.
[000229] The context modeling unit 3010 determines a context model used for the entropy coding of a symbol, based on hierarchical information from a data unit, to which a symbol belongs. Specifically, assuming that hierarchical information related to the hierarchically structured data unit, to which a currently decoded target symbol belongs, have a number I of state values, where I is a positive integer, the context modeling unit 3010 can define I or a smaller number of context models, according to a state value of hierarchical information, and can determine a context model to be used for the decoding of a current symbol, by assigning a context index indicating a number among the I or a smaller number of context models, according to the state value of the hierarchical information. In addition, in addition to the absolute data unit size information, as described above, relative hierarchical information, which indicates a relative size of a data unit, to which a symbol belongs to a larger data unit, can be used .
[000230] Information indicating a relationship between the size of a data unit, to which a current symbol belongs, and the size of a larger data unit, can be used as the hierarchical information. The 3010 context modeling unit can determine the size of a data unit, to which a current symbol belongs, using relative hierarchical information, which indicates a relative size of a data unit, to which the current symbol belongs in relation to the largest data unit as hierarchical information, and can determine a context model, based on the given size of a data unit. In addition, the context modeling unit 3010 can determine a context model used for entropy decoding a target symbol, based on a combination of hierarchical information and additional information, other than hierarchical information, according to the type of a symbol.
[000231] Specifically, supposing that hierarchical information related to the hierarchically structured data unit, to which a currently decoded destination symbol belongs, has number I of state values, and other non-hierarchical information, other than hierarchical information , have J number of state values, where J is a positive integer, the context modeling unit 3010 can define I x J or a smaller number of context models, according to a combination of I x J number of values status, and can define a context model used for decoding the current symbol, by assigning a context index indicating a number within I xj or a smaller number of context models, according to the status values of the hierarchical information a data unit, to which the current symbol belongs, and non-hierarchical information. In addition, the context model determined by the context modeling unit 3010, based on the combination of hierarchical information and non-hierarchical information, is defined as in the context modeling unit 1410 of the entropy coding apparatus 1400.
[000232] The context modeling unit 3010 is not limited to the embodiment described above, and one of the plurality of context models can be selected, combining various hierarchical information and non-hierarchical information, according to the type of one symbol to be decoded.
[000233] Probability estimator 3020 determines and issues information about a probability value of MPS and LPS and information about a binary signal corresponding to MPS and LPS among the binary signals 0 and 1, using the context index information issued by the unit of context modeling 3010. The probability value of MPS or LPS can be determined by reading a probability value indicated by a context index of a predefined query table. In addition, the probability value of MPS or LPS can be updated based on the statistical accumulation value of occurrence of a binary signal.
[000234] The normal 3030 decoder performs entropy decoding of a current symbol included in a bit stream based on the information from the binary signal and probability information corresponding to MPS or LPS, and outputs decoded symbol information.
[000235] Fig. 29 is a flow chart of a video decoding method, using a hierarchically structured data unit, according to another embodiment of the present invention. Referring to Fig. 29, in operation 3110, the symbol extraction unit 210 extracts a symbol from a coded frame, based on the hierarchically structured data unit, by analyzing an encoded bit stream.
[000236] In operation 3120, the entropy decoder 220 determines a context model used for the entropy decoding of a symbol, based on the hierarchical information of a data unit, to which a symbol belongs. In addition, the entropy decoder 220 can determine a context model to be applied to a current symbol among a plurality of context models, through a combination of information related to a hierarchical structure, and additional information, other than the information hierarchical structure.
[000237] Hierarchical information can be one of the information about the size of a data unit, to which a symbol belongs, and relative hierarchical information, which indicate a relative size of a data unit, to which a symbol belongs in relation to a higher level data unit, having a larger size than the data unit, to which the symbol belongs. Relative hierarchical information can include information about the size of a larger data unit, a division flag, indicating whether the largest data unit has been divided, or information about a relative proportion of the data size, to which a symbol belongs with respect to the largest data unit.
[000238] In operation 3130, entropy decoder 220 entrodically decodes a symbol, using the given context model. The symbol can include information about a transformation coefficient, information about the hierarchical structure of a transformation unit used for coding, using the hierarchically structured data unit, and information about a hierarchical structure of a frame.
[000239] In addition, the invention can be incorporated as computer-readable codes on a computer-readable recording medium. Computer-readable recording media is any data storage device, which can store data, which can be read later by a computer system. Examples of computer-readable recording media include read-only memory (ROM), random access memory (RAM), CD-ROMs, magnetic tapes, floppy disks, optical data storage devices, etc. The recording media readable by The computer, moreover, can be distributed over computer systems connected to the network, so that the computer-readable code is stored and executed in a distributed manner.
[000240] Although this invention has been specially shown and described with reference to its preferred embodiments, it should be clear to those of ordinary skill in the art, that various changes in form and details can be made, without abandoning the spirit and scope of invention, as defined by the added claims. Preferred embodiments should be considered only in the descriptive sense, and not for the purpose of limitation. Therefore, the scope of the invention is defined, not by the detailed description of the invention, but by the added claims, and all differences within the scope must be interpreted as being included in the present invention.

权利要求:
Claims (3)
[0001]
1. VIDEO DECODER METHOD, characterized by the fact that it comprises: receiving a bit stream including a transformation unit division flag indicating whether a transformation unit of a current transformation depth is divided, the transformation unit being included in a encoding unit (3110); determining a context index indicating a context model among a plurality of context models based on a size of the transformation unit of the current transformation depth (3120); obtain the transformation unit division flag by entropy decoding of the bit stream in the context model indicated by the determined context index (3130); and when the transformation unit division flag indicates a division of the transformation unit of the current transformation depth, divide the transformation unit of the current transformation depth into four rectangular transformation units of a lower transformation depth, where: a rectangular transformation unit is a shape whose width and height measurements have the same length, an image is divided into a plurality of maximum coding units according to information about the maximum coding unit size, a current maximum coding unit between the maximum coding units is hierarchically divided into one or more depth coding units including at least one of the current depth and a lower depth according to the division information, when the division information indicates a division for the current depth , the deep coding unit current is divided into four lower depth coding units, regardless of neighboring coding units, and when the division information indicates a non-division for the current depth, one or more transformation units are obtained from the coding unit the current depth.
[0002]
2. VIDEO DECODING METHOD, according to claim 1, characterized by the fact that the context model comprises information about a binary signal corresponding to a more likely symbol (MPS) and a less likely symbol (LPS) of 0 and 1, which are binary signals indicating the symbol and a probability value of at least one of the MPS and LPS, and the probability value of at least one of the MPS and LPS is determined based on a look-up table or a statistical accumulation value of occurrence of the binary signal.
[0003]
3. VIDEO ENCODING METHOD, characterized by the fact that it comprises: encoding a video signal frame based on a structured hierarchical data unit (2910); determine indicating a context index a context model among a plurality of context models used for entropy coding of a transformation unit division flag indicating whether a transformation unit of a current transformation depth is divided, the transformation unit being included in a coding unit (2920); and entropy code the transformation unit division flag using the context model indicated by the determined context index (2930), where the context model is determined based on a transformation unit size of a current transformation depth ; and when the transformation unit division flag indicates a transformation unit division of the current transformation depth, the transformation unit of the current transformation depth is divided into four rectangular transformation units of a lower transformation depth, where: a rectangular transformation unit is a shape whose width and height measurements have the same length, an image is divided into a plurality of maximum coding units according to information about the maximum size of the coding unit, a maximum coding unit current between the maximum coding units is hierarchically divided into one or more depth coding units including at least one of the current depth and a lower depth according to the division information, when the division information indicates a division for the depth current, the depth coding unit Current age is divided into four coding units of the lower depth, regardless of neighboring coding units, and when the division information indicates a non-division for the current depth, one or more transformation units are obtained from the coding unit the current depth.

类似技术:

---

公开号 | 公开日 | 专利标题

---

BR112013017395B1|2020-10-06|VIDEO DECODER METHOD, AND VIDEO ENCODER METHOD

---

AU2018200355B2|2018-11-22|Method and apparatus for entropy coding video and method and apparatus for entropy decoding video

---

BR122019014179B1|2021-03-09|video decoding method

---

BR122020014007B1|2022-02-01|Method to decode a video

---

BR122013019952A2|2020-09-15|VIDEO DECODING DEVICE

---

BR122013019015B1|2021-08-24|APPARATUS TO DECODE A VIDEO

---

BR122015013881A2|2020-09-01|METHOD FOR DECODING AN ENCODED VIDEO

---

BR122015021373A2|2019-08-27|device for decoding a video

---

BR112012025308B1|2022-02-08|METHOD OF ENCODING A VIDEO, METHOD OF DECODING AN ENCRYPTED VIDEO, VIDEO ENCODING EQUIPMENT INCLUDING A PROCESSOR, VIDEO DECODING EQUIPMENT INCLUDING A PROCESSOR, AND COMPUTER-LEABLE RECORDING MEDIA

---

BR122021004836B1|2022-02-08|METHOD TO DECODE AN ENCODED VIDEO

---

BR112014018115B1|2021-10-26|METHOD OF DECODING A VIDEO

---

BR122021004831B1|2022-02-01|Method to decode an encoded video

---

BR122021004622B1|2022-02-08|METHOD TO DECODE A VIDEO

---

BR122020001936B1|2021-05-25|method of decoding a video

同族专利:

---

公开号 | 公开日

---

US20150189279A1|2015-07-02|

---

JP6753916B2|2020-09-09|

---

BR122018076837B1|2020-12-01|

---

CN104811711A|2015-07-29|

---

ES2793963T3|2020-11-17|

---

US9407916B2|2016-08-02|

---

KR101552908B1|2015-09-15|

---

KR101579113B1|2015-12-23|

---

AU2016204370A1|2016-07-14|

---

US9313507B2|2016-04-12|

---

KR101573339B1|2015-12-01|

---

AU2018204232A1|2018-07-05|

---

EP2663075A4|2015-12-30|

---

CN103430541A|2013-12-04|

---

EP2663075A2|2013-11-13|

---

JP6231651B2|2017-11-15|

---

CN104811705A|2015-07-29|

---

CN104811703A|2015-07-29|

---

KR101578049B1|2015-12-16|

---

JP2017077002A|2017-04-20|

---

KR20140146558A|2014-12-26|

---

BR112013017395A2|2017-10-31|

---

US9479784B2|2016-10-25|

---

KR101457397B1|2014-11-04|

---

JP2014506064A|2014-03-06|

---

US9319689B2|2016-04-19|

---

CN104811705B|2018-05-08|

---

JP6054882B2|2016-12-27|

---

KR101932726B1|2018-12-27|

---

KR20140085391A|2014-07-07|

---

AU2012205077B2|2016-04-07|

---

KR20150040820A|2015-04-15|

---

JP2018050307A|2018-03-29|

---

KR20150040819A|2015-04-15|

---

AU2016204370B2|2017-03-09|

---

CN103430541B|2016-11-23|

---

JP2019062554A|2019-04-18|

---

CN104811703B|2018-04-20|

---

WO2012093891A2|2012-07-12|

---

US20150189278A1|2015-07-02|

---

KR101842571B1|2018-03-27|

---

CN104811706A|2015-07-29|

---

EP2663075B1|2020-05-06|

---

WO2012093891A3|2012-12-06|

---

KR20150040821A|2015-04-15|

---

AU2017203542B2|2018-03-15|

---

AU2018204232B2|2019-07-11|

---

JP6445651B2|2018-12-26|

---

AU2012205077A1|2013-08-01|

---

KR102013243B1|2019-08-22|

---

US20150189281A1|2015-07-02|

---

CN104796711B|2018-03-09|

---

US20130315300A1|2013-11-28|

---

US9313506B2|2016-04-12|

---

KR20120080140A|2012-07-16|

---

US20150189282A1|2015-07-02|

---

AU2017203542A1|2017-06-15|

---

KR20180137472A|2018-12-27|

---

PL2663075T3|2020-10-19|

---

CN104811711B|2019-02-15|

---

CN104796711A|2015-07-22|

---

CN104811706B|2017-10-27|

---

KR20180042828A|2018-04-26|

引用文献:

---

公开号 | 申请日 | 公开日 | 申请人 | 专利标题

---

---

JPH09505188A|1993-11-15|1997-05-20|ナショナル・セミコンダクター・コーポレイション|Quad-tree WALSH transform coding|

---

JP4610195B2|2001-12-17|2011-01-12|マイクロソフトコーポレーション|Skip macroblock coding|

---

CN101448162B|2001-12-17|2013-01-02|微软公司|Method for processing video image|

---

EP1322121A3|2001-12-19|2003-07-16|Matsushita Electric Industrial Co., Ltd.|Video encoder and decoder with improved motion detection precision|

---

JP4230188B2|2002-06-06|2009-02-25|パナソニック株式会社|Variable length encoding method and variable length decoding method|

---

JP2004282345A|2003-03-14|2004-10-07|Canon Inc|Image processor|

---

HU0301368A3|2003-05-20|2005-09-28|Amt Advanced Multimedia Techno|Method and equipment for compressing motion picture data|

---

US7769088B2|2003-05-28|2010-08-03|Broadcom Corporation|Context adaptive binary arithmetic code decoding engine|

---

US7580584B2|2003-07-18|2009-08-25|Microsoft Corporation|Adaptive multiple quantization|

---

KR20050045746A|2003-11-12|2005-05-17|삼성전자주식회사|Method and device for motion estimation using tree-structured variable block size|

---

US7894530B2|2004-05-07|2011-02-22|Broadcom Corporation|Method and system for dynamic selection of transform size in a video decoder based on signal content|

---

US8116374B2|2004-05-07|2012-02-14|Broadcom Corporation|Method and system for generating a transform size syntax element for video decoding|

---

US7929776B2|2005-03-10|2011-04-19|Qualcomm, Incorporated|Method and apparatus for error recovery using intra-slice resynchronization points|

---

KR100664936B1|2005-04-13|2007-01-04|삼성전자주식회사|Method and apparatus of context-based adaptive arithmetic coding and decoding with improved coding efficiency, and method and apparatus for video coding and decoding including the same|

---

KR100746007B1|2005-04-19|2007-08-06|삼성전자주식회사|Method and apparatus for adaptively selecting context model of entrophy coding|

---

CN100403801C|2005-09-23|2008-07-16|联合信源数字音视频技术（北京）有限公司|Adaptive entropy coding/decoding method based on context|

---

KR101349599B1|2005-09-26|2014-01-10|미쓰비시덴키 가부시키가이샤|Dynamic image decoding device|

---

KR100873636B1|2005-11-14|2008-12-12|삼성전자주식회사|Method and apparatus for encoding/decoding image using single coding mode|

---

US7245241B2|2005-11-25|2007-07-17|Microsoft Corporation|Image coding with scalable context quantization|

---

US8515194B2|2007-02-21|2013-08-20|Microsoft Corporation|Signaling and uses of windowing information for images|

---

US7518536B2|2007-03-30|2009-04-14|Hong Kong Applied Science And Technology Research Institute Co. Ltd.|Method and apparatus for debinarization of digital video data during decoding|

---

US8428133B2|2007-06-15|2013-04-23|Qualcomm Incorporated|Adaptive coding of video block prediction mode|

---

EP2081386A1|2008-01-18|2009-07-22|Panasonic Corporation|High precision edge prediction for intracoding|

---

KR20090129926A|2008-06-13|2009-12-17|삼성전자주식회사|Method and apparatus for image encoding by dynamic unit grouping, and method and apparatus for image decoding by dynamic unit grouping|

---

KR101517768B1|2008-07-02|2015-05-06|삼성전자주식회사|Method and apparatus for encoding video and method and apparatus for decoding video|

---

US8406307B2|2008-08-22|2013-03-26|Microsoft Corporation|Entropy coding/decoding of hierarchically organized data|

---

US8503527B2|2008-10-03|2013-08-06|Qualcomm Incorporated|Video coding with large macroblocks|

---

US8619856B2|2008-10-03|2013-12-31|Qualcomm Incorporated|Video coding with large macroblocks|

---

US20100278232A1|2009-05-04|2010-11-04|Sehoon Yea|Method Coding Multi-Layered Depth Images|

---

WO2010143853A2|2009-06-07|2010-12-16|엘지전자 주식회사|Method and apparatus for decoding a video signal|

---

US8294603B2|2009-06-30|2012-10-23|Massachusetts Institute Of Technology|System and method for providing high throughput entropy coding using syntax element partitioning|

---

KR101456498B1|2009-08-14|2014-10-31|삼성전자주식회사|Method and apparatus for video encoding considering scanning order of coding units with hierarchical structure, and method and apparatus for video decoding considering scanning order of coding units with hierarchical structure|

---

CN101820549B|2010-03-19|2011-10-19|西安电子科技大学|High-speed real-time processing arithmetic entropy coding system based on JPEG2000|

---

US8319672B2|2010-04-09|2012-11-27|Korea Electronics Technology Institute|Decoding device for context-based adaptive binary arithmetic coding technique|

---

US20110274162A1|2010-05-04|2011-11-10|Minhua Zhou|Coding Unit Quantization Parameters in Video Coding|

---

US9055305B2|2011-01-09|2015-06-09|Mediatek Inc.|Apparatus and method of sample adaptive offset for video coding|

---

US9661338B2|2010-07-09|2017-05-23|Qualcomm Incorporated|Coding syntax elements for adaptive scans of transform coefficients for video coding|

---

JP5134048B2|2010-07-23|2013-01-30|ソニー株式会社|Decoding apparatus and method, recording medium, and program|

---

US20120082235A1|2010-10-05|2012-04-05|General Instrument Corporation|Coding and decoding utilizing context model selection with adaptive scan pattern|

---

US9172963B2|2010-11-01|2015-10-27|Qualcomm Incorporated|Joint coding of syntax elements for video coding|

---

US9049444B2|2010-12-22|2015-06-02|Qualcomm Incorporated|Mode dependent scanning of coefficients of a block of video data|

---

US10992958B2|2010-12-29|2021-04-27|Qualcomm Incorporated|Video coding using mapped transforms and scanning modes|

---

US9210442B2|2011-01-12|2015-12-08|Google Technology Holdings LLC|Efficient transform unit representation|US8755620B2|2011-01-12|2014-06-17|Panasonic Corporation|Image coding method, image decoding method, image coding apparatus, image decoding apparatus, and image coding and decoding apparatus for performing arithmetic coding and/or arithmetic decoding|

---

MY164252A|2011-07-01|2017-11-30|Samsung Electronics Co Ltd|Method and apparatus for entropy encoding using hierarchical data unit, and method and apparatus for decoding|

---

US9800870B2|2011-09-16|2017-10-24|Qualcomm Incorporated|Line buffer reduction for short distance intra-prediction|

---

US9749645B2|2012-06-22|2017-08-29|Microsoft Technology Licensing, Llc|Coded-block-flag coding and derivation|

---

DK3361732T3|2012-07-02|2020-01-02|Samsung Electronics Co Ltd|Entropy coding of a video and entropy decoding of a video|

---

US9088770B2|2012-08-15|2015-07-21|Intel Corporation|Size based transform unit context derivation|

---

US9894385B2|2013-01-02|2018-02-13|Lg Electronics Inc.|Video signal processing method and device|

---

EP2966866A4|2013-04-05|2016-10-26|Samsung Electronics Co Ltd|Video encoding method and apparatus thereof, and a video decoding method and apparatus thereof|

---

US20150063464A1|2013-08-30|2015-03-05|Qualcomm Incorporated|Lookup table coding|

---

US20150189269A1|2013-12-30|2015-07-02|Google Inc.|Recursive block partitioning|

---

US10687079B2|2014-03-13|2020-06-16|Qualcomm Incorporated|Constrained depth intra mode coding for 3D video coding|

---

CN105578180B|2014-10-16|2019-01-15|联想有限公司|A kind of coding method and device|

---

CN105787985B|2014-12-24|2019-08-27|联想有限公司|Depth map processing method, device and electronic equipment|

---

US9781424B2|2015-01-19|2017-10-03|Google Inc.|Efficient context handling in arithmetic coding|

---

CN105992000B|2015-03-06|2019-03-22|扬智科技股份有限公司|The processing method and its image processor of video stream|

---

US9942548B2|2016-02-16|2018-04-10|Google Llc|Entropy coding transform partitioning information|

---

US11064205B2|2017-03-21|2021-07-13|Lg Electronics Inc.|Image decoding method and device according to intra prediction in image coding system|

---

CN110832857A|2017-07-07|2020-02-21|三星电子株式会社|Video encoding method and device and video decoding method and device|

---

US10506242B2|2018-01-30|2019-12-10|Google Llc|Efficient context model computation design in transform coefficient coding|

---

US10869060B2|2018-01-30|2020-12-15|Google Llc|Efficient context model computation design in transform coefficient coding|

---

US10887594B2|2018-07-05|2021-01-05|Mediatek Inc.|Entropy coding of coding units in image and video data|

---

JP2020161045A|2019-03-28|2020-10-01|三菱日立パワーシステムズ株式会社|Operation plan creation device, operation plan creation method, and program|

---

CN111988629A|2019-05-22|2020-11-24|富士通株式会社|Image encoding method and apparatus, image decoding method and apparatus|

---

US11190777B2|2019-06-30|2021-11-30|Tencent America LLC|Method and apparatus for video coding|

法律状态:
2018-03-27| B15K| Others concerning applications: alteration of classification|Ipc: H04N 7/00 (2011.01) |

---

2018-12-18| B06F| Objections, documents and/or translations needed after an examination request according art. 34 industrial property law|

---

2019-04-30| B12F| Appeal: other appeals|

---

2019-12-10| B15K| Others concerning applications: alteration of classification|Free format text: A CLASSIFICACAO ANTERIOR ERA: H04N 7/00 Ipc: H04N 19/13 (2014.01), H04N 19/157 (2014.01), H04N |

---

2019-12-17| B06A| Notification to applicant to reply to the report for non-patentability or inadequacy of the application according art. 36 industrial patent law|

---

2020-05-12| B09A| Decision: intention to grant|

---

2020-10-06| B16A| Patent or certificate of addition of invention granted|Free format text: PRAZO DE VALIDADE: 20 (VINTE) ANOS CONTADOS A PARTIR DE 06/01/2012, OBSERVADAS AS CONDICOES LEGAIS. |

优先权:

---

申请号 | 申请日 | 专利标题

---

US201161430322P| true| 2011-01-06|2011-01-06|

---

US61/430,322|2011-01-06|

---

PCT/KR2012/000155|WO2012093891A2|2011-01-06|2012-01-06|Encoding method and device of video using data unit of hierarchical structure, and decoding method and device thereof|BR122018076837-1A| BR122018076837B1|2011-01-06|2012-01-06|video decoder device|